Jul 21 20:14:13.615753 ip-10-0-141-220 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 20:14:14.035578 ip-10-0-141-220 kubenswrapper[2541]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 20:14:14.035578 ip-10-0-141-220 kubenswrapper[2541]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 20:14:14.035578 ip-10-0-141-220 kubenswrapper[2541]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 20:14:14.035578 ip-10-0-141-220 kubenswrapper[2541]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 20:14:14.035578 ip-10-0-141-220 kubenswrapper[2541]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 20:14:14.036265 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.035602    2541 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 20:14:14.039330 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039312    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:14.039330 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039329    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039333    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039336    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039339    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039342    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039345    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039348    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039350    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039353    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039356    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039359    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039362    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039366    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039368    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039371    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039373    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039378    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039382    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039385    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039388    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:14.039398 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039391    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039394    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039396    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039398    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039402    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039406    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039409    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039412    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039414    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039417    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039419    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039422    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039425    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039440    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039443    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039445    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039448    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039451    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039453    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039456    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:14.039892 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039458    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039460    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039463    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039465    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039468    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039470    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039473    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039475    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039478    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039481    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039483    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039486    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039488    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039491    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039494    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039497    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039499    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039502    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039504    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039507    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:14.040365 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039509    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039513    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039516    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039519    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039522    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039525    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039527    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039530    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039533    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039535    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039538    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039541    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039543    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039546    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039549    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039551    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039553    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039556    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039559    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:14.040867 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039563    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039565    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039568    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039571    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039574    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039576    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039579    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039583    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039586    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039588    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039591    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039594    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039597    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039599    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039602    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039604    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039606    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039609    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.039611    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:14.041313 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040322    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040329    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040332    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040335    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040338    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040341    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040344    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040346    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040349    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040352    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040354    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040357    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040359    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040362    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040364    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040367    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040369    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040372    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040375    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040380    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:14.041783 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040383    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040386    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040389    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040391    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040394    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040396    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040399    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040401    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040404    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040406    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040408    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040411    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040413    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040416    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040418    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040421    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040424    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040426    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040445    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040448    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:14.042270 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040450    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040453    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040455    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040458    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040460    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040463    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040465    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040468    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040470    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040473    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040475    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040479    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040482    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040484    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040487    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040490    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040492    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040495    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040497    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040500    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:14.042857 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040503    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040506    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040511    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040515    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040518    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040521    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040523    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040527    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040530    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040533    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040536    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040538    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040541    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040543    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040546    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040548    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040551    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040553    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040555    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:14.043339 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040559    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040561    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040564    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040566    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040573    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040576    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040579    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040581    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040584    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040587    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040589    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040594    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040597    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040599    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040602    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040605    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040607    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040610    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040612    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:14.043804 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.040615    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041001    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041005    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041008    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041013    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041017    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041020    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041023    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041026    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041029    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041031    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041034    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041037    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041041    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041044    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041047    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041049    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041054    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:14.044257 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041057    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041060    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041063    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041065    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041068    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041070    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041073    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041075    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041077    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041080    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041082    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041085    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041087    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041089    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041092    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041094    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041097    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041099    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041102    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041104    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:14.044718 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041107    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041110    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041112    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041114    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041117    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041120    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041122    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041125    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041127    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041129    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041132    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041135    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041138    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041141    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041143    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041146    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041148    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041151    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041154    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041156    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:14.045221 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041159    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041161    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041163    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041166    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041168    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041171    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041173    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041176    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041178    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041180    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041183    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041185    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041188    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041191    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041193    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041197    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041199    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041202    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041204    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041207    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:14.045739 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041209    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041211    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041214    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041218    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041221    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041224    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041226    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041229    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041231    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041233    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041236    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041238    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041241    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041243    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041246    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041250    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041253    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041256    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041258    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041261    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:14.046204 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041263    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041266    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041343    2541 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041355    2541 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041364    2541 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041371    2541 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041378    2541 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041383    2541 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041390    2541 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041395    2541 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041398    2541 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041402    2541 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041405    2541 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041408    2541 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041412    2541 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041417    2541 flags.go:64] FLAG: --cgroup-root=""
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041420    2541 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041423    2541 flags.go:64] FLAG: --client-ca-file=""
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041426    2541 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041443    2541 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041448    2541 flags.go:64] FLAG: --cluster-domain=""
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041451    2541 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041454    2541 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041458    2541 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 20:14:14.046741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041461    2541 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041465    2541 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041468    2541 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041471    2541 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041474    2541 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041477    2541 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041480    2541 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041483    2541 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041486    2541 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041489    2541 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041493    2541 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041496    2541 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041499    2541 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041503    2541 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041506    2541 flags.go:64] FLAG: --enable-server="true"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041510    2541 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041515    2541 flags.go:64] FLAG: --event-burst="100"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041518    2541 flags.go:64] FLAG: --event-qps="50"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041520    2541 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041524    2541 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041526    2541 flags.go:64] FLAG: --eviction-hard=""
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041530    2541 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041533    2541 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041537    2541 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041540    2541 flags.go:64] FLAG: --eviction-soft=""
Jul 21 20:14:14.047311 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041543    2541 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041546    2541 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041549    2541 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041552    2541 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041554    2541 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041557    2541 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041560    2541 flags.go:64] FLAG: --feature-gates=""
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041564    2541 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041567    2541 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041570    2541 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041573    2541 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041576    2541 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041579    2541 flags.go:64] FLAG: --help="false"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041582    2541 flags.go:64] FLAG: --hostname-override="ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041585    2541 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041588    2541 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041590    2541 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041594    2541 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041597    2541 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041600    2541 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041604    2541 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041607    2541 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041609    2541 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 20:14:14.047946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041613    2541 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041616    2541 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041619    2541 flags.go:64] FLAG: --kube-reserved=""
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041622    2541 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041624    2541 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041627    2541 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041630    2541 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041634    2541 flags.go:64] FLAG: --lock-file=""
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041637    2541 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041640    2541 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041642    2541 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041648    2541 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041651    2541 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041654    2541 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041657    2541 flags.go:64] FLAG: --logging-format="text"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041659    2541 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041663    2541 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041665    2541 flags.go:64] FLAG: --manifest-url=""
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041668    2541 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041672    2541 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041675    2541 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041679    2541 flags.go:64] FLAG: --max-pods="110"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041682    2541 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041685    2541 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041688    2541 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 20:14:14.048616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041690    2541 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041693    2541 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041696    2541 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041699    2541 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041707    2541 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041710    2541 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041713    2541 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041716    2541 flags.go:64] FLAG: --pod-cidr=""
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041719    2541 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041725    2541 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041728    2541 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041731    2541 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041734    2541 flags.go:64] FLAG: --port="10250"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041736    2541 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041740    2541 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07f899cf8e1760de1"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041744    2541 flags.go:64] FLAG: --qos-reserved=""
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041747    2541 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041750    2541 flags.go:64] FLAG: --register-node="true"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041753    2541 flags.go:64] FLAG: --register-with-taints=""
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041756    2541 flags.go:64] FLAG: --registry-burst="10"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041759    2541 flags.go:64] FLAG: --registry-qps="5"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041762    2541 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041764    2541 flags.go:64] FLAG: --reserved-memory=""
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041768    2541 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041771    2541 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 20:14:14.049253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041774    2541 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041776    2541 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041779    2541 flags.go:64] FLAG: --runonce="false"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041782    2541 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041785    2541 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041788    2541 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041791    2541 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041794    2541 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041797    2541 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041800    2541 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041803    2541 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041806    2541 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041811    2541 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041813    2541 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041816    2541 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041819    2541 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041823    2541 flags.go:64] FLAG: --system-cgroups=""
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041826    2541 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041832    2541 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041834    2541 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041837    2541 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041843    2541 flags.go:64] FLAG: --tls-min-version=""
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041846    2541 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041849    2541 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041851    2541 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 20:14:14.049888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041854    2541 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041857    2541 flags.go:64] FLAG: --v="2"
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041861    2541 flags.go:64] FLAG: --version="false"
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041865    2541 flags.go:64] FLAG: --vmodule=""
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041869    2541 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.041872    2541 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.041997    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042001    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042004    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042007    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042010    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042012    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042015    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042018    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042020    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042022    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042025    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042028    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042030    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042036    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042039    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:14.050545 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042042    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042044    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042047    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042050    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042052    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042055    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042058    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042061    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042064    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042066    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042069    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042072    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042074    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042077    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042080    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042082    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042086    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042089    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042092    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042094    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:14.051041 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042097    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042099    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042101    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042104    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042107    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042109    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042112    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042114    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042117    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042119    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042123    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042125    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042128    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042130    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042133    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042136    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042139    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042141    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042143    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042148    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:14.051592 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042150    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042152    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042155    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042158    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042160    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042163    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042165    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042168    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042170    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042174    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042178    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042181    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042183    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042186    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042188    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042191    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042193    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042196    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042198    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:14.052076 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042201    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042203    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042206    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042209    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042212    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042214    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042217    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042220    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042223    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042227    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042230    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042234    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042239    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042241    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042244    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042247    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042249    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042252    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042254    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:14.052555 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042257    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042259    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042261    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042264    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042266    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.042270    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.042275    2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.050467    2541 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.050485    2541 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.051313    2541 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.051322    2541 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051385    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051390    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051393    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051396    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:14.053031 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051399    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051401    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051404    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051406    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051409    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051411    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051414    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051416    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051419    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051422    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051425    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051444    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051452    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051458    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051461    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051465    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051467    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051470    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051472    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051475    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:14.053402 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051478    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051480    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051483    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051485    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051488    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051493    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051495    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051498    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051501    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051503    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051506    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051508    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051511    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051514    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051516    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051519    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051522    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051527    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051531    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051535    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:14.053894 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051540    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051542    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051545    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051547    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051550    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051552    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051554    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051557    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051559    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051561    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051564    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051566    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051568    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051571    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051573    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051576    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051579    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051581    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051585    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051587    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:14.054413 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051591    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051595    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051598    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051601    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051604    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051608    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051612    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051617    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051621    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051625    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051627    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051630    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051632    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051635    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051637    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051639    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051642    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051644    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051647    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051650    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:14.054976 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051652    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051654    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051657    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051659    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051663    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051666    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051669    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051672    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051675    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051678    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051682    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051685    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051691    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051695    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:14.055501 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051699    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.051706    2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051833    2541 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051839    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051842    2541 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051845    2541 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051848    2541 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051853    2541 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051857    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051862    2541 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051866    2541 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051870    2541 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051872    2541 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051875    2541 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051877    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:14.055849 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051880    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051882    2541 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051885    2541 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051887    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051889    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051892    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051894    2541 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051896    2541 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051899    2541 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051901    2541 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051904    2541 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051908    2541 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051913    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051916    2541 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051919    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051923    2541 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051926    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051928    2541 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051932    2541 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:14.056240 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051937    2541 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051941    2541 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051945    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051950    2541 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051953    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051956    2541 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051958    2541 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051960    2541 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051963    2541 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051966    2541 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051968    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051971    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051973    2541 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051976    2541 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051978    2541 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051981    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051983    2541 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051985    2541 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051988    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051990    2541 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:14.056708 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051993    2541 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051995    2541 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.051998    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052000    2541 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052003    2541 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052006    2541 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052009    2541 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052013    2541 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052018    2541 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052023    2541 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052028    2541 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052032    2541 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052035    2541 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052037    2541 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052040    2541 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052042    2541 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052045    2541 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052047    2541 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052050    2541 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:14.057201 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052052    2541 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052055    2541 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052057    2541 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052060    2541 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052062    2541 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052064    2541 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052067    2541 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052069    2541 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052072    2541 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052074    2541 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052076    2541 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052079    2541 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052082    2541 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052084    2541 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052087    2541 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052089    2541 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052092    2541 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052095    2541 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052100    2541 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052106    2541 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:14.057765 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052112    2541 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052116    2541 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052118    2541 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052121    2541 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052124    2541 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052126    2541 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052128    2541 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:14.052131    2541 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.052136    2541 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.052272    2541 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.054466    2541 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.056115    2541 server.go:1019] "Starting client certificate rotation"
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.056208    2541 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 20:14:14.058249 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.057065    2541 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 20:14:14.058650 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.058636    2541 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 20:14:14.063081 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.063034    2541 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 20:14:14.071953 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.071934    2541 log.go:25] "Validated CRI v1 runtime API"
Jul 21 20:14:14.073976 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.073960    2541 log.go:25] "Validated CRI v1 image API"
Jul 21 20:14:14.077839 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.077821    2541 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 20:14:14.083639 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.083620    2541 fs.go:135] Filesystem UUIDs: map[3992d852-5ba0-450a-95e3-8d0b28a6ccca:/dev/nvme0n1p4 4ca0551e-032f-46af-bb38-7371150a6fb5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 21 20:14:14.083716 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.083638    2541 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 20:14:14.088887 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.088773    2541 manager.go:216] Machine: {Timestamp:2026-07-21 20:14:14.087345504 +0000 UTC m=+0.346136420 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103863 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2938b0d8cf8cd447f37da5fd2b8b66 SystemUUID:ec2938b0-d8cf-8cd4-47f3-7da5fd2b8b66 BootID:9dafb2f2-0119-417c-b0b5-5bf357bd2743 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:85:cc:ae:37:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:85:cc:ae:37:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:c6:28:7d:c2:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 20:14:14.088887 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.088885    2541 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 20:14:14.088971 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.088964    2541 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 20:14:14.089574 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.089559    2541 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 20:14:14.091742 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.091711    2541 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 20:14:14.091891 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.091746    2541 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 20:14:14.092478 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.092468    2541 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 20:14:14.092513 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.092481    2541 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 20:14:14.092513 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.092489    2541 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 20:14:14.092985 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.092974    2541 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 20:14:14.094057 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.094048    2541 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 20:14:14.097235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.097224    2541 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 20:14:14.097366 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.097357    2541 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 20:14:14.097402 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.097394    2541 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 20:14:14.097448 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.097413    2541 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 20:14:14.097448 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.097440    2541 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 20:14:14.097509 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.097451    2541 kubelet.go:398] "Adding apiserver pod source"
Jul 21 20:14:14.097509 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.097468    2541 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 20:14:14.098039 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.098022    2541 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 20:14:14.098097 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.098048    2541 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 20:14:14.101165 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.101147    2541 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 20:14:14.102922 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.102908    2541 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 20:14:14.102982 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.102939    2541 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 20:14:14.108104 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108085    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 20:14:14.108104 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108108    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108117    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108124    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108135    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108143    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108154    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108162    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108172    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108180    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108193    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 20:14:14.108235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108201    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 20:14:14.108963 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.108944    2541 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k9khr"
Jul 21 20:14:14.109030 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.109010    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 20:14:14.109030 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.109026    2541 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 20:14:14.111114 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.111065    2541 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 20:14:14.111203 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.111145    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 20:14:14.111203 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.111151    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 20:14:14.112343 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.112329    2541 server.go:1268] "Started kubelet"
Jul 21 20:14:14.112468 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.112406    2541 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 20:14:14.112535 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.112478    2541 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 20:14:14.112582 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.112539    2541 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 20:14:14.113336 ip-10-0-141-220 systemd[1]: Started Kubernetes Kubelet.
Jul 21 20:14:14.114150 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.114133    2541 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 20:14:14.114520 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.114507    2541 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 20:14:14.116602 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.116582    2541 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k9khr"
Jul 21 20:14:14.118067 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.118045    2541 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 20:14:14.120266 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.120246    2541 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 20:14:14.120266 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.120252    2541 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 20:14:14.120423 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.120400    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:14.120921 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.120860    2541 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 20:14:14.120921 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.120884    2541 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 20:14:14.120921 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.120916    2541 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 20:14:14.121137 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.121048    2541 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 20:14:14.121137 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.121059    2541 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 20:14:14.121215 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.121173    2541 factory.go:55] Registering systemd factory
Jul 21 20:14:14.121215 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.121190    2541 factory.go:223] Registration of the systemd container factory successfully
Jul 21 20:14:14.123179 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.123165    2541 factory.go:153] Registering CRI-O factory
Jul 21 20:14:14.123289 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.123271    2541 factory.go:223] Registration of the crio container factory successfully
Jul 21 20:14:14.123383 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.123331    2541 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 20:14:14.123383 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.123373    2541 factory.go:103] Registering Raw factory
Jul 21 20:14:14.123495 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.123390    2541 manager.go:1196] Started watching for new ooms in manager
Jul 21 20:14:14.124206 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.124193    2541 manager.go:349] Starting recovery of all containers
Jul 21 20:14:14.128264 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.128203    2541 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:14.132863 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.132839    2541 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-220.ec2.internal\" not found" node="ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.134375 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.134201    2541 manager.go:354] Recovery completed
Jul 21 20:14:14.136485 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.136461    2541 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 21 20:14:14.140188 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.140175    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:14.142154 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.142134    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:14.142237 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.142163    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:14.142237 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.142174    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:14.142756 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.142740    2541 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 20:14:14.142805 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.142758    2541 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 20:14:14.142805 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.142777    2541 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 20:14:14.142870 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.142746    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:14.143565 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.143552    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:14.143620 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.143578    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:14.143620 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.143587    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:14.143817 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.143805    2541 policy_none.go:49] "None policy: Start"
Jul 21 20:14:14.143860 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.143822    2541 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 20:14:14.143860 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.143832    2541 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 20:14:14.144846 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.144834    2541 policy_none.go:47] "Start"
Jul 21 20:14:14.183140 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.183117    2541 manager.go:337] "Starting Device Plugin manager"
Jul 21 20:14:14.183237 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.183161    2541 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 20:14:14.183237 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.183175    2541 server.go:87] "Starting device plugin registration server"
Jul 21 20:14:14.183520 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.183504    2541 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 20:14:14.183593 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.183521    2541 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 20:14:14.183659 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.183628    2541 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 20:14:14.183754 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.183734    2541 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 20:14:14.183754 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.183767    2541 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 20:14:14.184322 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.184288    2541 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 20:14:14.184388 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.184338    2541 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:14.283650 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.283611    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:14.284919 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.284547    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:14.284919 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.284580    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:14.284919 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.284595    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:14.284919 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.284626    2541 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.285229 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.285206    2541 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 20:14:14.286646 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.286594    2541 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 20:14:14.286646 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.286630    2541 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 20:14:14.286779 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.286651    2541 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 20:14:14.286779 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.286694    2541 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 20:14:14.288853 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.288834    2541 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:14.294492 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.294470    2541 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.294492 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.294493    2541 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-220.ec2.internal\": node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:14.344652 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.344623    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:14.387703 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.387659    2541 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"]
Jul 21 20:14:14.387807 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.387764    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:14.388786 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.388769    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:14.388850 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.388801    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:14.388850 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.388812    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:14.390238 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.390226    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:14.390367 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.390352    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.390408 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.390385    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:14.391075 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.391056    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:14.391075 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.391072    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:14.391221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.391092    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:14.391221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.391098    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:14.391221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.391109    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:14.391221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.391112    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:14.392235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.392218    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.392331 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.392244    2541 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:14.392893 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.392881    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:14.392975 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.392903    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:14.392975 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.392915    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:14.417149 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.417120    2541 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-220.ec2.internal\" not found" node="ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.421457 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.421442    2541 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-220.ec2.internal\" not found" node="ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.423524 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.423509    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/308ee4caaf9bf6f3f74bf9ae70434436-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"308ee4caaf9bf6f3f74bf9ae70434436\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.423575 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.423532    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/308ee4caaf9bf6f3f74bf9ae70434436-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"308ee4caaf9bf6f3f74bf9ae70434436\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.423575 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.423550    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96041acd692d509c9f6a5942e8259028-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"96041acd692d509c9f6a5942e8259028\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.445718 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.445692    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:14.524593 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.524563    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/308ee4caaf9bf6f3f74bf9ae70434436-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"308ee4caaf9bf6f3f74bf9ae70434436\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.524709 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.524595    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/308ee4caaf9bf6f3f74bf9ae70434436-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"308ee4caaf9bf6f3f74bf9ae70434436\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.524709 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.524614    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96041acd692d509c9f6a5942e8259028-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"96041acd692d509c9f6a5942e8259028\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.524709 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.524642    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/96041acd692d509c9f6a5942e8259028-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"96041acd692d509c9f6a5942e8259028\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.524709 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.524665    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/308ee4caaf9bf6f3f74bf9ae70434436-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"308ee4caaf9bf6f3f74bf9ae70434436\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.524709 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.524681    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/308ee4caaf9bf6f3f74bf9ae70434436-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"308ee4caaf9bf6f3f74bf9ae70434436\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.546041 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.545970    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:14.646111 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.646064    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:14.720280 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.720252    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.725004 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:14.724987    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:14.746749 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.746718    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:14.847284 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.847194    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:14.948884 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:14.948850    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:15.049730 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:15.049703    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:15.055092 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.055069    2541 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 20:14:15.055279 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.055245    2541 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 20:14:15.055341 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.055272    2541 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 20:14:15.121476 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.121370    2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 20:09:14 +0000 UTC" deadline="2028-05-05 05:54:57.531289512 +0000 UTC"
Jul 21 20:14:15.121476 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.121405    2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15681h40m42.409888315s"
Jul 21 20:14:15.149897 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:15.149859    2541 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 21 20:14:15.209258 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.209232    2541 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:15.221152 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.221123    2541 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:15.228993 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.228973    2541 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:15.234780 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.234760    2541 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 20:14:15.235890 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.235872    2541 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 21 20:14:15.248135 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.248118    2541 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 20:14:15.625682 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:15.625628    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96041acd692d509c9f6a5942e8259028.slice/crio-1e209e7cc9dfd188eabe022afda53e92fc034ecf23ab60db87ffdac72219db7c WatchSource:0}: Error finding container 1e209e7cc9dfd188eabe022afda53e92fc034ecf23ab60db87ffdac72219db7c: Status 404 returned error can't find the container with id 1e209e7cc9dfd188eabe022afda53e92fc034ecf23ab60db87ffdac72219db7c
Jul 21 20:14:15.626069 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:15.626047    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308ee4caaf9bf6f3f74bf9ae70434436.slice/crio-56da56e3f2b42d02de21b3995eab6f564718a8774d53227b221f9bbee13254da WatchSource:0}: Error finding container 56da56e3f2b42d02de21b3995eab6f564718a8774d53227b221f9bbee13254da: Status 404 returned error can't find the container with id 56da56e3f2b42d02de21b3995eab6f564718a8774d53227b221f9bbee13254da
Jul 21 20:14:15.632988 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:15.632968    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:14:16.099275 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.099242    2541 apiserver.go:52] "Watching apiserver"
Jul 21 20:14:16.109671 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.109630    2541 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 20:14:16.110469 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.110443    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487","openshift-dns/node-resolver-txw4j","openshift-image-registry/node-ca-bmf5j","openshift-multus/multus-additional-cni-plugins-jxh7q","openshift-multus/network-metrics-daemon-fg49f","openshift-ovn-kubernetes/ovnkube-node-2q9sv","kube-system/konnectivity-agent-x6pj8","openshift-cluster-node-tuning-operator/tuned-wh897","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal","openshift-multus/multus-wr26p","openshift-network-diagnostics/network-check-target-p8fjh","openshift-network-operator/iptables-alerter-n4xts","kube-system/global-pull-secret-syncer-xfxkp"]
Jul 21 20:14:16.113022 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.112995    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.115245 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.114937    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.115817 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.115794    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 20:14:16.116128 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.116097    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6lnsg\""
Jul 21 20:14:16.116128 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.116113    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 20:14:16.116128 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.116119    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 20:14:16.116333 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.116227    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 20:14:16.116333 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.116290    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.116440 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.116368    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 20:14:16.116440 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.116380    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 20:14:16.117435 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.117163    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:14:16.118759 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.117572    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.118759 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.117790    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 20:14:16.118759 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.118305    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 20:14:16.118759 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.118556    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k69kk\""
Jul 21 20:14:16.118759 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.118661    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c6nth\""
Jul 21 20:14:16.119002 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.118991    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 20:14:16.119243 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.119186    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 20:14:16.119340 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.119256    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.120184 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.119975    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 20:14:16.120184 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.119982    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8p957\""
Jul 21 20:14:16.120184 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.120058    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 20:14:16.120373 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.120279    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 20:14:16.120681 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.120664    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:16.121489 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.120763    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:16.121489 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.121393    2541 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 20:14:16.123661 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.122251    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 20:14:16.123661 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.122535    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.123661 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.122618    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 20:14:16.123661 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.122826    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mgd2v\""
Jul 21 20:14:16.123661 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.122921    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 20:14:16.123661 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.123022    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 20:14:16.123661 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.123133    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 20:14:16.124331 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.124311    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.124434 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.124395    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:16.124825 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.124808    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:14:16.125000 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.124984    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kt2f2\""
Jul 21 20:14:16.125121 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.125106    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 20:14:16.125561 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.125543    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.128019 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.127997    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 20:14:16.128128 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.128069    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 20:14:16.128190 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.127999    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4fm8r\""
Jul 21 20:14:16.128296 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.128278    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 20:14:16.128535 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.128494    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:16.130012 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.129991    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.131308 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.131284    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 20:14:16.131476 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.131339    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:16.131610 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.131541    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:16.131610 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.131586    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 20:14:16.132335 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.132313    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 20:14:16.132671 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.132579    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g694g\""
Jul 21 20:14:16.133552 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.132735    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-os-release\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.134098 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.134058    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j77wv\""
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.134360    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-modprobe-d\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.134429    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-var-lib-kubelet\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.134469    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-cni-bin\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.134595    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eef9c323-9001-4032-b9b3-b2e5dcf0390e-env-overrides\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.134629    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a5ffcbb-669e-4511-b0a6-6ed1d322eacf-host-slash\") pod \"iptables-alerter-n4xts\" (UID: \"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf\") " pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.134743    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-cnibin\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.134851    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.134881    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl2k5\" (UniqueName: \"kubernetes.io/projected/3c00aa3f-d728-4277-8963-35c4c74467d2-kube-api-access-hl2k5\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135125    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eef9c323-9001-4032-b9b3-b2e5dcf0390e-ovnkube-config\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135162    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c00aa3f-d728-4277-8963-35c4c74467d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135195    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135226    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lwcm\" (UniqueName: \"kubernetes.io/projected/652b5972-8788-425f-8c44-478a6f4a071f-kube-api-access-7lwcm\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135258    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ae0a64e-c4e8-48fc-81cf-68955534f595-host\") pod \"node-ca-bmf5j\" (UID: \"1ae0a64e-c4e8-48fc-81cf-68955534f595\") " pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135697    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-lib-modules\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135730    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4184633-e680-48b7-8f43-bfdfc7674721-tmp\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.137527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135759    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-run-systemd\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135788    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-run-ovn\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135811    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc89a228-d422-40b1-99e3-3aaaa739c6c7-hosts-file\") pod \"node-resolver-txw4j\" (UID: \"bc89a228-d422-40b1-99e3-3aaaa739c6c7\") " pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135841    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c00aa3f-d728-4277-8963-35c4c74467d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135875    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c00aa3f-d728-4277-8963-35c4c74467d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135909    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-var-lib-openvswitch\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.135944    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jg9b\" (UniqueName: \"kubernetes.io/projected/bc89a228-d422-40b1-99e3-3aaaa739c6c7-kube-api-access-5jg9b\") pod \"node-resolver-txw4j\" (UID: \"bc89a228-d422-40b1-99e3-3aaaa739c6c7\") " pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136292    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2kjb\" (UniqueName: \"kubernetes.io/projected/1ae0a64e-c4e8-48fc-81cf-68955534f595-kube-api-access-q2kjb\") pod \"node-ca-bmf5j\" (UID: \"1ae0a64e-c4e8-48fc-81cf-68955534f595\") " pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136328    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4184633-e680-48b7-8f43-bfdfc7674721-etc-tuned\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136371    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-kubelet\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136402    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-run-netns\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136429    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-run-openvswitch\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136461    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-cni-netd\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136491    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eef9c323-9001-4032-b9b3-b2e5dcf0390e-ovn-node-metrics-cert\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136541    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4t8p\" (UniqueName: \"kubernetes.io/projected/0a5ffcbb-669e-4511-b0a6-6ed1d322eacf-kube-api-access-v4t8p\") pod \"iptables-alerter-n4xts\" (UID: \"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf\") " pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136572    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-systemd-units\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.138295 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136601    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-sysconfig\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136633    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-kubernetes\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136669    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-systemd\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136697    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-run\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136724    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-sys\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136750    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-host\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136808    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ae0a64e-c4e8-48fc-81cf-68955534f595-serviceca\") pod \"node-ca-bmf5j\" (UID: \"1ae0a64e-c4e8-48fc-81cf-68955534f595\") " pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136833    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-sysctl-d\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.136866    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-sysctl-conf\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.137366    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-log-socket\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.137403    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eef9c323-9001-4032-b9b3-b2e5dcf0390e-ovnkube-script-lib\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.137434    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jskwk\" (UniqueName: \"kubernetes.io/projected/eef9c323-9001-4032-b9b3-b2e5dcf0390e-kube-api-access-jskwk\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.139049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.137467    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc89a228-d422-40b1-99e3-3aaaa739c6c7-tmp-dir\") pod \"node-resolver-txw4j\" (UID: \"bc89a228-d422-40b1-99e3-3aaaa739c6c7\") " pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.139632 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.137498    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-system-cni-dir\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.139785 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.139653    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4sqg\" (UniqueName: \"kubernetes.io/projected/c4184633-e680-48b7-8f43-bfdfc7674721-kube-api-access-x4sqg\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.139785 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.139691    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-slash\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.139785 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.139715    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-etc-openvswitch\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.139785 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.139736    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-node-log\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.139785 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.139762    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-run-ovn-kubernetes\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.139785 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.139783    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.140104 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.139804    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a5ffcbb-669e-4511-b0a6-6ed1d322eacf-iptables-alerter-script\") pod \"iptables-alerter-n4xts\" (UID: \"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf\") " pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.141998 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.141965    2541 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 20:14:16.167270 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.166584    2541 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dwqbr"
Jul 21 20:14:16.176079 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.176043    2541 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dwqbr"
Jul 21 20:14:16.222445 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.222410    2541 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 20:14:16.240590 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240553    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-var-lib-kubelet\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.240590 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240595    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-conf-dir\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.240590 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240612    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-daemon-config\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.240922 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240643    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2kjb\" (UniqueName: \"kubernetes.io/projected/1ae0a64e-c4e8-48fc-81cf-68955534f595-kube-api-access-q2kjb\") pod \"node-ca-bmf5j\" (UID: \"1ae0a64e-c4e8-48fc-81cf-68955534f595\") " pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.240922 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240671    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-run-netns\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.240922 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240696    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-cni-netd\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.240922 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240753    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-cni-netd\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.240922 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240809    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-run-netns\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.240922 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240915    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eef9c323-9001-4032-b9b3-b2e5dcf0390e-ovn-node-metrics-cert\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240944    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4t8p\" (UniqueName: \"kubernetes.io/projected/0a5ffcbb-669e-4511-b0a6-6ed1d322eacf-kube-api-access-v4t8p\") pod \"iptables-alerter-n4xts\" (UID: \"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf\") " pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.240984    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-socket-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241010    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-systemd-units\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241033    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-sysconfig\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241048    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-systemd\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241065    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-sys\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241080    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-host\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241096    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-system-cni-dir\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241113    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-hostroot\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241129    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-sysctl-conf\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241149    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jskwk\" (UniqueName: \"kubernetes.io/projected/eef9c323-9001-4032-b9b3-b2e5dcf0390e-kube-api-access-jskwk\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241166    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241185    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-run-netns\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241204    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-var-lib-cni-bin\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.241221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241220    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241237    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-node-log\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241252    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-os-release\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241274    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241291    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lwcm\" (UniqueName: \"kubernetes.io/projected/652b5972-8788-425f-8c44-478a6f4a071f-kube-api-access-7lwcm\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241320    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-modprobe-d\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241335    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-system-cni-dir\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241353    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-cnibin\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241368    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-os-release\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241387    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eef9c323-9001-4032-b9b3-b2e5dcf0390e-ovnkube-config\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241404    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c00aa3f-d728-4277-8963-35c4c74467d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241419    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4184633-e680-48b7-8f43-bfdfc7674721-tmp\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241443    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-run-ovn\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241459    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc89a228-d422-40b1-99e3-3aaaa739c6c7-hosts-file\") pod \"node-resolver-txw4j\" (UID: \"bc89a228-d422-40b1-99e3-3aaaa739c6c7\") " pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241468    2541 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241505    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c00aa3f-d728-4277-8963-35c4c74467d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241527    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc89a228-d422-40b1-99e3-3aaaa739c6c7-hosts-file\") pod \"node-resolver-txw4j\" (UID: \"bc89a228-d422-40b1-99e3-3aaaa739c6c7\") " pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241545    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/849977c0-4669-47fa-ac22-45fa370aadf4-kubelet-config\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.241930 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241583    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-host\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241603    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-system-cni-dir\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241611    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-sysconfig\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241656    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-systemd\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241660    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-sys\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241704    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-os-release\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241702    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-etc-selinux\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241721    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-node-log\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241883    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-var-lib-openvswitch\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241917    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-run-multus-certs\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241936    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-sysctl-conf\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241947    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4184633-e680-48b7-8f43-bfdfc7674721-etc-tuned\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241977    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-kubelet\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242003    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-run-openvswitch\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242031    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-var-lib-cni-multus\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242058    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df954f93-2c91-4c1b-bb08-21fcadbdb4bd-agent-certs\") pod \"konnectivity-agent-x6pj8\" (UID: \"df954f93-2c91-4c1b-bb08-21fcadbdb4bd\") " pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242087    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-kubernetes\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.242895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.241979    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-run-ovn\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242203    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-run\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242231    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-log-socket\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242257    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc89a228-d422-40b1-99e3-3aaaa739c6c7-tmp-dir\") pod \"node-resolver-txw4j\" (UID: \"bc89a228-d422-40b1-99e3-3aaaa739c6c7\") " pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242284    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242307    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-registration-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242325    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ae0a64e-c4e8-48fc-81cf-68955534f595-serviceca\") pod \"node-ca-bmf5j\" (UID: \"1ae0a64e-c4e8-48fc-81cf-68955534f595\") " pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242362    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-sysctl-d\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242380    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eef9c323-9001-4032-b9b3-b2e5dcf0390e-ovnkube-script-lib\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242397    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m7fl\" (UniqueName: \"kubernetes.io/projected/84aff1d7-90dc-4b0d-87cf-c5741cae3029-kube-api-access-9m7fl\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242416    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-device-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242452    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-kubelet\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242478    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4sqg\" (UniqueName: \"kubernetes.io/projected/c4184633-e680-48b7-8f43-bfdfc7674721-kube-api-access-x4sqg\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242492    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-run-openvswitch\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242516    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-slash\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242527    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c00aa3f-d728-4277-8963-35c4c74467d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242547    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-etc-openvswitch\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.243776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242559    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-run\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242586    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-run-ovn-kubernetes\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242604    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-modprobe-d\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242609    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-etc-openvswitch\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242617    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242617    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-systemd-units\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242678    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242709    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-slash\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242744    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-log-socket\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.242950    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242959    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc89a228-d422-40b1-99e3-3aaaa739c6c7-tmp-dir\") pod \"node-resolver-txw4j\" (UID: \"bc89a228-d422-40b1-99e3-3aaaa739c6c7\") " pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.243044    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:14:16.743002197 +0000 UTC m=+3.001793130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243151    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243213    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ae0a64e-c4e8-48fc-81cf-68955534f595-serviceca\") pod \"node-ca-bmf5j\" (UID: \"1ae0a64e-c4e8-48fc-81cf-68955534f595\") " pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243224    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-kubernetes\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243264    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-run-ovn-kubernetes\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.242679    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-var-lib-openvswitch\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.244735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243264    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a5ffcbb-669e-4511-b0a6-6ed1d322eacf-iptables-alerter-script\") pod \"iptables-alerter-n4xts\" (UID: \"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf\") " pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243336    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eef9c323-9001-4032-b9b3-b2e5dcf0390e-ovnkube-config\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243399    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-etc-sysctl-d\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243445    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl2k5\" (UniqueName: \"kubernetes.io/projected/3c00aa3f-d728-4277-8963-35c4c74467d2-kube-api-access-hl2k5\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243572    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-cni-dir\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243574    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eef9c323-9001-4032-b9b3-b2e5dcf0390e-ovnkube-script-lib\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243613    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-var-lib-kubelet\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243661    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-var-lib-kubelet\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243686    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-cni-bin\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243728    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-host-cni-bin\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243729    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eef9c323-9001-4032-b9b3-b2e5dcf0390e-env-overrides\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243774    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a5ffcbb-669e-4511-b0a6-6ed1d322eacf-host-slash\") pod \"iptables-alerter-n4xts\" (UID: \"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf\") " pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243884    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-cnibin\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243913    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a5ffcbb-669e-4511-b0a6-6ed1d322eacf-host-slash\") pod \"iptables-alerter-n4xts\" (UID: \"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf\") " pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243949    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84aff1d7-90dc-4b0d-87cf-c5741cae3029-cni-binary-copy\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.243959    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c00aa3f-d728-4277-8963-35c4c74467d2-cnibin\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244000    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-etc-kubernetes\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.245380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244025    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a5ffcbb-669e-4511-b0a6-6ed1d322eacf-iptables-alerter-script\") pod \"iptables-alerter-n4xts\" (UID: \"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf\") " pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244034    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244084    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4lzk\" (UniqueName: \"kubernetes.io/projected/722f3604-2594-4b6e-bbad-77b616830cd5-kube-api-access-d4lzk\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244116    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df954f93-2c91-4c1b-bb08-21fcadbdb4bd-konnectivity-ca\") pod \"konnectivity-agent-x6pj8\" (UID: \"df954f93-2c91-4c1b-bb08-21fcadbdb4bd\") " pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244148    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ae0a64e-c4e8-48fc-81cf-68955534f595-host\") pod \"node-ca-bmf5j\" (UID: \"1ae0a64e-c4e8-48fc-81cf-68955534f595\") " pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244177    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-lib-modules\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244152    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eef9c323-9001-4032-b9b3-b2e5dcf0390e-env-overrides\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244206    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-run-systemd\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244237    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c00aa3f-d728-4277-8963-35c4c74467d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244243    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ae0a64e-c4e8-48fc-81cf-68955534f595-host\") pod \"node-ca-bmf5j\" (UID: \"1ae0a64e-c4e8-48fc-81cf-68955534f595\") " pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244261    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eef9c323-9001-4032-b9b3-b2e5dcf0390e-run-systemd\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244291    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-socket-dir-parent\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244329    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4184633-e680-48b7-8f43-bfdfc7674721-lib-modules\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244405    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-run-k8s-cni-cncf-io\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244451    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-sys-fs\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244477    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jg9b\" (UniqueName: \"kubernetes.io/projected/bc89a228-d422-40b1-99e3-3aaaa739c6c7-kube-api-access-5jg9b\") pod \"node-resolver-txw4j\" (UID: \"bc89a228-d422-40b1-99e3-3aaaa739c6c7\") " pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244495    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/849977c0-4669-47fa-ac22-45fa370aadf4-dbus\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.246130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244690    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c00aa3f-d728-4277-8963-35c4c74467d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.246736 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.244887    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c00aa3f-d728-4277-8963-35c4c74467d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.246736 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.245824    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eef9c323-9001-4032-b9b3-b2e5dcf0390e-ovn-node-metrics-cert\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.247351 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.247320    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4184633-e680-48b7-8f43-bfdfc7674721-etc-tuned\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.249222 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.249196    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4184633-e680-48b7-8f43-bfdfc7674721-tmp\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.251102 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.251076    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2kjb\" (UniqueName: \"kubernetes.io/projected/1ae0a64e-c4e8-48fc-81cf-68955534f595-kube-api-access-q2kjb\") pod \"node-ca-bmf5j\" (UID: \"1ae0a64e-c4e8-48fc-81cf-68955534f595\") " pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.251269 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.251252    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jskwk\" (UniqueName: \"kubernetes.io/projected/eef9c323-9001-4032-b9b3-b2e5dcf0390e-kube-api-access-jskwk\") pod \"ovnkube-node-2q9sv\" (UID: \"eef9c323-9001-4032-b9b3-b2e5dcf0390e\") " pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.252088 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.252048    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4t8p\" (UniqueName: \"kubernetes.io/projected/0a5ffcbb-669e-4511-b0a6-6ed1d322eacf-kube-api-access-v4t8p\") pod \"iptables-alerter-n4xts\" (UID: \"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf\") " pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.253905 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.253882    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lwcm\" (UniqueName: \"kubernetes.io/projected/652b5972-8788-425f-8c44-478a6f4a071f-kube-api-access-7lwcm\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:16.256472 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.256437    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4sqg\" (UniqueName: \"kubernetes.io/projected/c4184633-e680-48b7-8f43-bfdfc7674721-kube-api-access-x4sqg\") pod \"tuned-wh897\" (UID: \"c4184633-e680-48b7-8f43-bfdfc7674721\") " pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.257227 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.257208    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl2k5\" (UniqueName: \"kubernetes.io/projected/3c00aa3f-d728-4277-8963-35c4c74467d2-kube-api-access-hl2k5\") pod \"multus-additional-cni-plugins-jxh7q\" (UID: \"3c00aa3f-d728-4277-8963-35c4c74467d2\") " pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.258014 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.257990    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jg9b\" (UniqueName: \"kubernetes.io/projected/bc89a228-d422-40b1-99e3-3aaaa739c6c7-kube-api-access-5jg9b\") pod \"node-resolver-txw4j\" (UID: \"bc89a228-d422-40b1-99e3-3aaaa739c6c7\") " pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.277629 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.277595    2541 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:16.292698 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.292645    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" event={"ID":"96041acd692d509c9f6a5942e8259028","Type":"ContainerStarted","Data":"1e209e7cc9dfd188eabe022afda53e92fc034ecf23ab60db87ffdac72219db7c"}
Jul 21 20:14:16.294118 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.294072    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"308ee4caaf9bf6f3f74bf9ae70434436","Type":"ContainerStarted","Data":"56da56e3f2b42d02de21b3995eab6f564718a8774d53227b221f9bbee13254da"}
Jul 21 20:14:16.345195 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345160    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/849977c0-4669-47fa-ac22-45fa370aadf4-kubelet-config\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.345195 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345201    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-etc-selinux\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345225    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-run-multus-certs\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345256    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-var-lib-cni-multus\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345280    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df954f93-2c91-4c1b-bb08-21fcadbdb4bd-agent-certs\") pod \"konnectivity-agent-x6pj8\" (UID: \"df954f93-2c91-4c1b-bb08-21fcadbdb4bd\") " pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345307    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-registration-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345305    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/849977c0-4669-47fa-ac22-45fa370aadf4-kubelet-config\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345348    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-var-lib-cni-multus\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345397    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-registration-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345401    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-etc-selinux\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345441    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-run-multus-certs\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345490    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m7fl\" (UniqueName: \"kubernetes.io/projected/84aff1d7-90dc-4b0d-87cf-c5741cae3029-kube-api-access-9m7fl\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345524    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-device-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345586    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-cni-dir\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345607    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84aff1d7-90dc-4b0d-87cf-c5741cae3029-cni-binary-copy\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345623    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-etc-kubernetes\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345638    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345643    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-device-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345656    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4lzk\" (UniqueName: \"kubernetes.io/projected/722f3604-2594-4b6e-bbad-77b616830cd5-kube-api-access-d4lzk\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345676    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df954f93-2c91-4c1b-bb08-21fcadbdb4bd-konnectivity-ca\") pod \"konnectivity-agent-x6pj8\" (UID: \"df954f93-2c91-4c1b-bb08-21fcadbdb4bd\") " pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345690    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-etc-kubernetes\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345694    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-socket-dir-parent\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345732    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345735    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-run-k8s-cni-cncf-io\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345766    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-sys-fs\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345771    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-cni-dir\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345806    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/849977c0-4669-47fa-ac22-45fa370aadf4-dbus\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345832    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-var-lib-kubelet\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.345959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345839    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-sys-fs\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345856    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-conf-dir\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345879    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-daemon-config\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345898    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/849977c0-4669-47fa-ac22-45fa370aadf4-dbus\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345906    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-socket-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345937    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-hostroot\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345943    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-conf-dir\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345965    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345980    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-var-lib-kubelet\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345993    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-run-netns\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346023    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-hostroot\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346032    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/722f3604-2594-4b6e-bbad-77b616830cd5-socket-dir\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346062    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-var-lib-cni-bin\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.345768    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-run-k8s-cni-cncf-io\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346020    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-var-lib-cni-bin\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346115    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346163    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-system-cni-dir\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346171    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df954f93-2c91-4c1b-bb08-21fcadbdb4bd-konnectivity-ca\") pod \"konnectivity-agent-x6pj8\" (UID: \"df954f93-2c91-4c1b-bb08-21fcadbdb4bd\") " pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:16.346800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346190    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-cnibin\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346213    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-os-release\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346258    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-host-run-netns\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.346336    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346346    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-system-cni-dir\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346383    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-cnibin\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346387    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84aff1d7-90dc-4b0d-87cf-c5741cae3029-cni-binary-copy\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.346408    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret podName:849977c0-4669-47fa-ac22-45fa370aadf4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:16.846387255 +0000 UTC m=+3.105178175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret") pod "global-pull-secret-syncer-xfxkp" (UID: "849977c0-4669-47fa-ac22-45fa370aadf4") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346412    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-os-release\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346477    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-socket-dir-parent\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.347465 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.346967    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84aff1d7-90dc-4b0d-87cf-c5741cae3029-multus-daemon-config\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.349594 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.349541    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df954f93-2c91-4c1b-bb08-21fcadbdb4bd-agent-certs\") pod \"konnectivity-agent-x6pj8\" (UID: \"df954f93-2c91-4c1b-bb08-21fcadbdb4bd\") " pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:16.356785 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.356763    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:16.356903 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.356794    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:16.356903 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.356809    2541 projected.go:196] Error preparing data for projected volume kube-api-access-gd547 for pod openshift-network-diagnostics/network-check-target-p8fjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:16.356903 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.356894    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547 podName:254e9344-0bc6-44eb-99ef-8b3474648596 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:16.85687274 +0000 UTC m=+3.115663653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gd547" (UniqueName: "kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547") pod "network-check-target-p8fjh" (UID: "254e9344-0bc6-44eb-99ef-8b3474648596") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:16.359046 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.359018    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m7fl\" (UniqueName: \"kubernetes.io/projected/84aff1d7-90dc-4b0d-87cf-c5741cae3029-kube-api-access-9m7fl\") pod \"multus-wr26p\" (UID: \"84aff1d7-90dc-4b0d-87cf-c5741cae3029\") " pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.359696 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.359678    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4lzk\" (UniqueName: \"kubernetes.io/projected/722f3604-2594-4b6e-bbad-77b616830cd5-kube-api-access-d4lzk\") pod \"aws-ebs-csi-driver-node-zj487\" (UID: \"722f3604-2594-4b6e-bbad-77b616830cd5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.428925 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.428885    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:16.438537 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.438499    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n4xts"
Jul 21 20:14:16.448583 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.448554    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-txw4j"
Jul 21 20:14:16.455276 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.455253    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bmf5j"
Jul 21 20:14:16.463466 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.463425    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxh7q"
Jul 21 20:14:16.471916 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.471892    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wh897"
Jul 21 20:14:16.477775 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.477747    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487"
Jul 21 20:14:16.486616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.486588    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:16.494581 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.494555    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wr26p"
Jul 21 20:14:16.541511 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.541478    2541 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:16.748935 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.748829    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:16.749096 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.748970    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:16.749096 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.749060    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:14:17.749035564 +0000 UTC m=+4.007826493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:16.850081 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.850032    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:16.850276 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.850172    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:16.850276 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.850246    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret podName:849977c0-4669-47fa-ac22-45fa370aadf4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:17.850224699 +0000 UTC m=+4.109015607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret") pod "global-pull-secret-syncer-xfxkp" (UID: "849977c0-4669-47fa-ac22-45fa370aadf4") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:16.951120 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:16.951086    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:16.951319 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.951294    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:16.951319 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.951320    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:16.951401 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.951331    2541 projected.go:196] Error preparing data for projected volume kube-api-access-gd547 for pod openshift-network-diagnostics/network-check-target-p8fjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:16.951401 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:16.951396    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547 podName:254e9344-0bc6-44eb-99ef-8b3474648596 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:17.951377104 +0000 UTC m=+4.210168017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gd547" (UniqueName: "kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547") pod "network-check-target-p8fjh" (UID: "254e9344-0bc6-44eb-99ef-8b3474648596") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:17.178887 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:17.178837    2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 20:09:16 +0000 UTC" deadline="2028-03-25 09:59:51.179712995 +0000 UTC"
Jul 21 20:14:17.178887 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:17.178873    2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14701h45m34.000843225s"
Jul 21 20:14:17.566876 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:17.566843    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc89a228_d422_40b1_99e3_3aaaa739c6c7.slice/crio-b1c48bf7489c737e727d69b432a4f783ed14835ba80d8b3ad49144ab2318c658 WatchSource:0}: Error finding container b1c48bf7489c737e727d69b432a4f783ed14835ba80d8b3ad49144ab2318c658: Status 404 returned error can't find the container with id b1c48bf7489c737e727d69b432a4f783ed14835ba80d8b3ad49144ab2318c658
Jul 21 20:14:17.569675 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:17.569470    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef9c323_9001_4032_b9b3_b2e5dcf0390e.slice/crio-2516758ccc433e66b0040bae67c86e3b13da3831aa62762ff8e0fa990e7b323d WatchSource:0}: Error finding container 2516758ccc433e66b0040bae67c86e3b13da3831aa62762ff8e0fa990e7b323d: Status 404 returned error can't find the container with id 2516758ccc433e66b0040bae67c86e3b13da3831aa62762ff8e0fa990e7b323d
Jul 21 20:14:17.570543 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:17.570402    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a5ffcbb_669e_4511_b0a6_6ed1d322eacf.slice/crio-3fa4b20cf6c99e4444b08948ebb84c0188dd2062cc04ddebc6a4cbdf52a60088 WatchSource:0}: Error finding container 3fa4b20cf6c99e4444b08948ebb84c0188dd2062cc04ddebc6a4cbdf52a60088: Status 404 returned error can't find the container with id 3fa4b20cf6c99e4444b08948ebb84c0188dd2062cc04ddebc6a4cbdf52a60088
Jul 21 20:14:17.572650 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:17.572587    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c00aa3f_d728_4277_8963_35c4c74467d2.slice/crio-ff07ff29cd3e80a802ee76b080ca8f4a46ba15da79224d5fbb4ee7f8ef7a8fc0 WatchSource:0}: Error finding container ff07ff29cd3e80a802ee76b080ca8f4a46ba15da79224d5fbb4ee7f8ef7a8fc0: Status 404 returned error can't find the container with id ff07ff29cd3e80a802ee76b080ca8f4a46ba15da79224d5fbb4ee7f8ef7a8fc0
Jul 21 20:14:17.573677 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:17.573244    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4184633_e680_48b7_8f43_bfdfc7674721.slice/crio-2e0c3742b3227338346a141777e2825f37e1584738f3fc12c498c62c0c44d05b WatchSource:0}: Error finding container 2e0c3742b3227338346a141777e2825f37e1584738f3fc12c498c62c0c44d05b: Status 404 returned error can't find the container with id 2e0c3742b3227338346a141777e2825f37e1584738f3fc12c498c62c0c44d05b
Jul 21 20:14:17.579123 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:17.579037    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf954f93_2c91_4c1b_bb08_21fcadbdb4bd.slice/crio-e21761acc93301330f474fe63b325243e0885d3d6e382448e988b1f408e2524c WatchSource:0}: Error finding container e21761acc93301330f474fe63b325243e0885d3d6e382448e988b1f408e2524c: Status 404 returned error can't find the container with id e21761acc93301330f474fe63b325243e0885d3d6e382448e988b1f408e2524c
Jul 21 20:14:17.757445 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:17.757261    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:17.757617 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:17.757425    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:17.757663 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:17.757627    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:14:19.757607331 +0000 UTC m=+6.016398236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:17.858119 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:17.858074    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:17.858287 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:17.858259    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:17.858369 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:17.858348    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret podName:849977c0-4669-47fa-ac22-45fa370aadf4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:19.858326484 +0000 UTC m=+6.117117410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret") pod "global-pull-secret-syncer-xfxkp" (UID: "849977c0-4669-47fa-ac22-45fa370aadf4") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:17.959574 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:17.959538    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:17.959754 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:17.959679    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:17.959754 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:17.959697    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:17.959754 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:17.959706    2541 projected.go:196] Error preparing data for projected volume kube-api-access-gd547 for pod openshift-network-diagnostics/network-check-target-p8fjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:17.959871 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:17.959758    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547 podName:254e9344-0bc6-44eb-99ef-8b3474648596 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:19.959744018 +0000 UTC m=+6.218534925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gd547" (UniqueName: "kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547") pod "network-check-target-p8fjh" (UID: "254e9344-0bc6-44eb-99ef-8b3474648596") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:18.180596 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.180291    2541 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 20:09:16 +0000 UTC" deadline="2027-12-29 07:20:41.685560858 +0000 UTC"
Jul 21 20:14:18.180596 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.180361    2541 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12611h6m23.505205113s"
Jul 21 20:14:18.290415 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.290381    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:18.290624 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:18.290560    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:18.291322 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.290985    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:18.291322 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:18.291122    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:18.291322 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.291190    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:18.291322 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:18.291264    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:18.313422 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.313383    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxh7q" event={"ID":"3c00aa3f-d728-4277-8963-35c4c74467d2","Type":"ContainerStarted","Data":"ff07ff29cd3e80a802ee76b080ca8f4a46ba15da79224d5fbb4ee7f8ef7a8fc0"}
Jul 21 20:14:18.333173 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.333087    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n4xts" event={"ID":"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf","Type":"ContainerStarted","Data":"3fa4b20cf6c99e4444b08948ebb84c0188dd2062cc04ddebc6a4cbdf52a60088"}
Jul 21 20:14:18.350582 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.350471    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-txw4j" event={"ID":"bc89a228-d422-40b1-99e3-3aaaa739c6c7","Type":"ContainerStarted","Data":"b1c48bf7489c737e727d69b432a4f783ed14835ba80d8b3ad49144ab2318c658"}
Jul 21 20:14:18.365237 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.365194    2541 generic.go:356] "Generic (PLEG): container finished" podID="308ee4caaf9bf6f3f74bf9ae70434436" containerID="3ed83d17986a268bab22f47ab75b96bc4719978f2c44d635b172e05dd2a55fcd" exitCode=0
Jul 21 20:14:18.365902 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.365794    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"308ee4caaf9bf6f3f74bf9ae70434436","Type":"ContainerDied","Data":"3ed83d17986a268bab22f47ab75b96bc4719978f2c44d635b172e05dd2a55fcd"}
Jul 21 20:14:18.372845 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.372809    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x6pj8" event={"ID":"df954f93-2c91-4c1b-bb08-21fcadbdb4bd","Type":"ContainerStarted","Data":"e21761acc93301330f474fe63b325243e0885d3d6e382448e988b1f408e2524c"}
Jul 21 20:14:18.384848 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.384815    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487" event={"ID":"722f3604-2594-4b6e-bbad-77b616830cd5","Type":"ContainerStarted","Data":"4c085cecd7039eb367ed8c3502613b7ba4b1723c20b32af702d15fa6fcd29c50"}
Jul 21 20:14:18.408081 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.408037    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" event={"ID":"eef9c323-9001-4032-b9b3-b2e5dcf0390e","Type":"ContainerStarted","Data":"2516758ccc433e66b0040bae67c86e3b13da3831aa62762ff8e0fa990e7b323d"}
Jul 21 20:14:18.430300 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.430231    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wr26p" event={"ID":"84aff1d7-90dc-4b0d-87cf-c5741cae3029","Type":"ContainerStarted","Data":"c1c20e4dbf42faec808bbf79d0f3e3676db042e4733236509e9e3164f469c824"}
Jul 21 20:14:18.451796 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.451696    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" event={"ID":"96041acd692d509c9f6a5942e8259028","Type":"ContainerStarted","Data":"54c0d8720aa8c38a3ed522d89a0f157f7332857490d73d1864e970e24d26955b"}
Jul 21 20:14:18.477169 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.477096    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bmf5j" event={"ID":"1ae0a64e-c4e8-48fc-81cf-68955534f595","Type":"ContainerStarted","Data":"48789fb902b2d1a50c71697ce93718bb34e56393260d0746937882c397fa0883"}
Jul 21 20:14:18.502405 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:18.502273    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wh897" event={"ID":"c4184633-e680-48b7-8f43-bfdfc7674721","Type":"ContainerStarted","Data":"2e0c3742b3227338346a141777e2825f37e1584738f3fc12c498c62c0c44d05b"}
Jul 21 20:14:19.521152 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:19.520980    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"308ee4caaf9bf6f3f74bf9ae70434436","Type":"ContainerStarted","Data":"0d869eaa17b8049e714d754bad34b35b21b3cfc682e899aa6e9f17249aece7e2"}
Jul 21 20:14:19.536853 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:19.536768    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" podStartSLOduration=4.536744958 podStartE2EDuration="4.536744958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:19.53576488 +0000 UTC m=+5.794555809" watchObservedRunningTime="2026-07-21 20:14:19.536744958 +0000 UTC m=+5.795535887"
Jul 21 20:14:19.537175 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:19.537141    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" podStartSLOduration=4.537131271 podStartE2EDuration="4.537131271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:18.468142291 +0000 UTC m=+4.726933247" watchObservedRunningTime="2026-07-21 20:14:19.537131271 +0000 UTC m=+5.795922201"
Jul 21 20:14:19.780080 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:19.779984    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:19.780253 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:19.780162    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:19.780253 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:19.780233    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:14:23.780211608 +0000 UTC m=+10.039002526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:19.881024 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:19.880981    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:19.881219 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:19.881172    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:19.881279 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:19.881242    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret podName:849977c0-4669-47fa-ac22-45fa370aadf4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:23.881220574 +0000 UTC m=+10.140011500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret") pod "global-pull-secret-syncer-xfxkp" (UID: "849977c0-4669-47fa-ac22-45fa370aadf4") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:19.981933 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:19.981887    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:19.982173 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:19.982119    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:19.982173 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:19.982140    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:19.982173 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:19.982154    2541 projected.go:196] Error preparing data for projected volume kube-api-access-gd547 for pod openshift-network-diagnostics/network-check-target-p8fjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:19.982337 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:19.982217    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547 podName:254e9344-0bc6-44eb-99ef-8b3474648596 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:23.982197267 +0000 UTC m=+10.240988189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gd547" (UniqueName: "kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547") pod "network-check-target-p8fjh" (UID: "254e9344-0bc6-44eb-99ef-8b3474648596") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:20.300434 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:20.300398    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:20.300833 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:20.300431    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:20.300833 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:20.300571    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:20.300833 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:20.300644    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:20.300833 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:20.300729    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:20.300833 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:20.300817    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:22.292283 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:22.292196    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:22.292728 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:22.292343    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:22.292728 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:22.292450    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:22.292728 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:22.292545    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:22.292728 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:22.292588    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:22.292728 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:22.292655    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:23.815463 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:23.815410    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:23.815933 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:23.815570    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:23.815933 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:23.815642    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:14:31.815626294 +0000 UTC m=+18.074417219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:23.916000 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:23.915958    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:23.916165 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:23.916137    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:23.916218 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:23.916201    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret podName:849977c0-4669-47fa-ac22-45fa370aadf4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:31.916184397 +0000 UTC m=+18.174975318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret") pod "global-pull-secret-syncer-xfxkp" (UID: "849977c0-4669-47fa-ac22-45fa370aadf4") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:24.017026 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:24.016985    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:24.017207 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:24.017178    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:24.017292 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:24.017217    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:24.017292 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:24.017230    2541 projected.go:196] Error preparing data for projected volume kube-api-access-gd547 for pod openshift-network-diagnostics/network-check-target-p8fjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:24.017398 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:24.017293    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547 podName:254e9344-0bc6-44eb-99ef-8b3474648596 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:32.017273373 +0000 UTC m=+18.276064289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gd547" (UniqueName: "kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547") pod "network-check-target-p8fjh" (UID: "254e9344-0bc6-44eb-99ef-8b3474648596") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:24.296950 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:24.296878    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:24.297097 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:24.296997    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:24.297097 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:24.297046    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:24.297215 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:24.297119    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:24.297258 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:24.297231    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:24.297339 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:24.297314    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:26.287844 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:26.287753    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:26.288306 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:26.287895    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:26.288306 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:26.288259    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:26.288417 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:26.288346    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:26.288417 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:26.288396    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:26.288585 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:26.288498    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:28.290607 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:28.290576    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:28.290607 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:28.290607    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:28.291033 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:28.290708    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:28.291033 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:28.290734    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:28.291033 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:28.290810    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:28.291033 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:28.290907    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:30.287359 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:30.287307    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:30.287883 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:30.287306    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:30.287883 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:30.287465    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:30.287883 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:30.287582    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:30.287883 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:30.287304    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:30.287883 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:30.287708    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:31.878854 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:31.878814    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:31.879267 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:31.878930    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:31.879267 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:31.878984    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:14:47.878970084 +0000 UTC m=+34.137760987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:31.979330 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:31.979274    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:31.979529 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:31.979464    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:31.979576 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:31.979549    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret podName:849977c0-4669-47fa-ac22-45fa370aadf4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:47.979524507 +0000 UTC m=+34.238315431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret") pod "global-pull-secret-syncer-xfxkp" (UID: "849977c0-4669-47fa-ac22-45fa370aadf4") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:32.080298 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:32.080266    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:32.080500 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:32.080474    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:32.080500 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:32.080503    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:32.080675 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:32.080517    2541 projected.go:196] Error preparing data for projected volume kube-api-access-gd547 for pod openshift-network-diagnostics/network-check-target-p8fjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:32.080675 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:32.080584    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547 podName:254e9344-0bc6-44eb-99ef-8b3474648596 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:48.080564323 +0000 UTC m=+34.339355236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gd547" (UniqueName: "kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547") pod "network-check-target-p8fjh" (UID: "254e9344-0bc6-44eb-99ef-8b3474648596") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:32.287067 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:32.286977    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:32.287238 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:32.286977    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:32.287238 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:32.287119    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:32.287238 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:32.286977    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:32.287395 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:32.287200    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:32.287395 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:32.287304    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:34.288175 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:34.288132    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:34.288634 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:34.288232    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:34.288634 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:34.288251    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:34.288634 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:34.288282    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:34.288634 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:34.288373    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:34.288634 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:34.288485    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:36.287498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:36.287463    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:36.288064 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:36.287462    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:36.288064 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:36.287608    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:36.288064 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:36.287462    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:36.288064 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:36.287693    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:36.288064 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:36.287755    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:37.566197 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.565806    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" event={"ID":"eef9c323-9001-4032-b9b3-b2e5dcf0390e","Type":"ContainerStarted","Data":"74176b19ed9fa5fd796ab91cf40fb82b3fb3ef6ad61908e14abf465207103e83"}
Jul 21 20:14:37.566983 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.566254    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" event={"ID":"eef9c323-9001-4032-b9b3-b2e5dcf0390e","Type":"ContainerStarted","Data":"2e49d136643ad5b10a7e95466576c122cd8f55bb89884646206c44ab28c78ce4"}
Jul 21 20:14:37.566983 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.566305    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" event={"ID":"eef9c323-9001-4032-b9b3-b2e5dcf0390e","Type":"ContainerStarted","Data":"7fb0bfaf2c0f9d34c407132fff84156fd46cd557a86d2485623da0aae252fca9"}
Jul 21 20:14:37.566983 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.566348    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" event={"ID":"eef9c323-9001-4032-b9b3-b2e5dcf0390e","Type":"ContainerStarted","Data":"b9825cf9764df2e34f532707acb5fb5024fb625c439c3cf0817333a38321626c"}
Jul 21 20:14:37.566983 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.566385    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" event={"ID":"eef9c323-9001-4032-b9b3-b2e5dcf0390e","Type":"ContainerStarted","Data":"6a6a9ee4a6adf0f66488fa016bca08ab3c3c0e13f3a42f0cd41205f7c41e0756"}
Jul 21 20:14:37.566983 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.566417    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" event={"ID":"eef9c323-9001-4032-b9b3-b2e5dcf0390e","Type":"ContainerStarted","Data":"f5c2f502e548a504eef38eddf80a78264bd3e2610ffad49c7a157c5952084c04"}
Jul 21 20:14:37.568583 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.568558    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wr26p" event={"ID":"84aff1d7-90dc-4b0d-87cf-c5741cae3029","Type":"ContainerStarted","Data":"30a51c7596fef825b85ea968c91fd78407529c3710440c6a4f422c3121b19e34"}
Jul 21 20:14:37.570152 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.570131    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bmf5j" event={"ID":"1ae0a64e-c4e8-48fc-81cf-68955534f595","Type":"ContainerStarted","Data":"bd98d096312745c4864355e0b16ae34a5b009a3020f8fafe27f70d5fa705a8ff"}
Jul 21 20:14:37.571480 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.571458    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wh897" event={"ID":"c4184633-e680-48b7-8f43-bfdfc7674721","Type":"ContainerStarted","Data":"900436e57f103ebb7a6665ed314462317e5494befcaf4739f947783910f692bc"}
Jul 21 20:14:37.572856 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.572833    2541 generic.go:356] "Generic (PLEG): container finished" podID="3c00aa3f-d728-4277-8963-35c4c74467d2" containerID="b80a48c76df2219f5024ca7288ba242ee792bae89eb023a6f27899b4282d4c27" exitCode=0
Jul 21 20:14:37.572946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.572900    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxh7q" event={"ID":"3c00aa3f-d728-4277-8963-35c4c74467d2","Type":"ContainerDied","Data":"b80a48c76df2219f5024ca7288ba242ee792bae89eb023a6f27899b4282d4c27"}
Jul 21 20:14:37.574880 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.574857    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-txw4j" event={"ID":"bc89a228-d422-40b1-99e3-3aaaa739c6c7","Type":"ContainerStarted","Data":"d32a23e54c85a3c4eacab20a79452b5c5ca20ab08438a6d898e1083bf17a2512"}
Jul 21 20:14:37.576343 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.576323    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x6pj8" event={"ID":"df954f93-2c91-4c1b-bb08-21fcadbdb4bd","Type":"ContainerStarted","Data":"4ba39d243856fbd9db306a3fd36c60d662d3a6c44c3c3790b2227f6c95c110e2"}
Jul 21 20:14:37.579475 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.579453    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487" event={"ID":"722f3604-2594-4b6e-bbad-77b616830cd5","Type":"ContainerStarted","Data":"81ac75128b2d86bf674bb46160acc5cd884e698c3440ff33b548cce556307868"}
Jul 21 20:14:37.608400 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.608346    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wr26p" podStartSLOduration=4.312983869 podStartE2EDuration="23.608332068s" totalImagesPullingTime="19.295348199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:37.60744343 +0000 UTC m=+23.866234368" watchObservedRunningTime="2026-07-21 20:14:37.608332068 +0000 UTC m=+23.867122992"
Jul 21 20:14:37.689725 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.689657    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-txw4j" podStartSLOduration=4.449342477 podStartE2EDuration="23.689641079s" totalImagesPullingTime="19.240298602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:37.641468072 +0000 UTC m=+23.900259190" watchObservedRunningTime="2026-07-21 20:14:37.689641079 +0000 UTC m=+23.948432005"
Jul 21 20:14:37.733040 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.732994    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x6pj8" podStartSLOduration=12.660784579 podStartE2EDuration="23.732979621s" totalImagesPullingTime="11.072195042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:37.712771091 +0000 UTC m=+23.971562033" watchObservedRunningTime="2026-07-21 20:14:37.732979621 +0000 UTC m=+23.991770545"
Jul 21 20:14:37.763723 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.763673    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bmf5j" podStartSLOduration=4.557508227 podStartE2EDuration="23.763658702s" totalImagesPullingTime="19.206150475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:37.733465804 +0000 UTC m=+23.992256742" watchObservedRunningTime="2026-07-21 20:14:37.763658702 +0000 UTC m=+24.022449627"
Jul 21 20:14:37.764050 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:37.764021    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wh897" podStartSLOduration=4.528926897 podStartE2EDuration="23.764012965s" totalImagesPullingTime="19.235086068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:37.763817171 +0000 UTC m=+24.022608096" watchObservedRunningTime="2026-07-21 20:14:37.764012965 +0000 UTC m=+24.022803889"
Jul 21 20:14:38.287387 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:38.287356    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:38.287565 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:38.287426    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:38.287565 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:38.287425    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:38.287565 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:38.287536    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:38.287713 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:38.287615    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:38.287770 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:38.287710    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:38.410455 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:38.410407    2541 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 20:14:38.584110 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:38.584070    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n4xts" event={"ID":"0a5ffcbb-669e-4511-b0a6-6ed1d322eacf","Type":"ContainerStarted","Data":"75cbe8e7a88e263c257da8f7ad2680bf7f1ba0a3f8a6b6182160be905ff86203"}
Jul 21 20:14:38.586585 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:38.586551    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487" event={"ID":"722f3604-2594-4b6e-bbad-77b616830cd5","Type":"ContainerStarted","Data":"cbf84b9d906a53e79957d707e08d346c016fa8eba7ad222bf497905d5ccc5878"}
Jul 21 20:14:38.622730 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:38.622677    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n4xts" podStartSLOduration=5.38632052 podStartE2EDuration="24.622654883s" totalImagesPullingTime="19.236334363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:38.622453155 +0000 UTC m=+24.881244102" watchObservedRunningTime="2026-07-21 20:14:38.622654883 +0000 UTC m=+24.881445810"
Jul 21 20:14:39.197629 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:39.197504    2541 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T20:14:38.410449907Z","UUID":"2e747ecc-9556-468b-9862-c1e4eb03906c","Handler":null,"Name":"","Endpoint":""}
Jul 21 20:14:39.199299 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:39.199278    2541 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 20:14:39.199425 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:39.199323    2541 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 20:14:40.056453 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.056406    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:40.057116 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.057088    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:40.287054 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.287027    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:40.287054 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.287043    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:40.287227 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.287027    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:40.287227 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:40.287130    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:40.287227 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:40.287216    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:40.287331 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:40.287294    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:40.594153 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.594114    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487" event={"ID":"722f3604-2594-4b6e-bbad-77b616830cd5","Type":"ContainerStarted","Data":"84b93fb460601f8e26cf557f6b8aa8adf799a0291c054b663b316f86ceada850"}
Jul 21 20:14:40.597989 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.597956    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" event={"ID":"eef9c323-9001-4032-b9b3-b2e5dcf0390e","Type":"ContainerStarted","Data":"48126ebbcc3a9a7c2e9c647ff391f4537519493c659413077193c4ca48a60209"}
Jul 21 20:14:40.598123 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.598051    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:40.598683 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.598667    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x6pj8"
Jul 21 20:14:40.680504 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:40.680447    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj487" podStartSLOduration=5.002474836 podStartE2EDuration="26.680409433s" totalImagesPullingTime="21.677934597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:40.641644789 +0000 UTC m=+26.900435714" watchObservedRunningTime="2026-07-21 20:14:40.680409433 +0000 UTC m=+26.939200359"
Jul 21 20:14:42.288041 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.287811    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:42.288762 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.287816    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:42.288762 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:42.288154    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:42.288762 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.287816    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:42.288762 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:42.288206    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:42.288762 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:42.288288    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:42.606029 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.605927    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" event={"ID":"eef9c323-9001-4032-b9b3-b2e5dcf0390e","Type":"ContainerStarted","Data":"4fd2c5e457f04f0ede3c6efe9268e6fdfeaef8144c39510596ebbd081d38ccf6"}
Jul 21 20:14:42.606199 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.606180    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:42.606281 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.606258    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:42.607855 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.607830    2541 generic.go:356] "Generic (PLEG): container finished" podID="3c00aa3f-d728-4277-8963-35c4c74467d2" containerID="4221bbfb2c9685864ef24f303d2798ef5f2042c0570505ad2f624f77d089a77c" exitCode=0
Jul 21 20:14:42.607983 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.607902    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxh7q" event={"ID":"3c00aa3f-d728-4277-8963-35c4c74467d2","Type":"ContainerDied","Data":"4221bbfb2c9685864ef24f303d2798ef5f2042c0570505ad2f624f77d089a77c"}
Jul 21 20:14:42.622521 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.622503    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:42.646401 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:42.646361    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv" podStartSLOduration=9.333611284 podStartE2EDuration="28.646348237s" totalImagesPullingTime="19.312736953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:42.64562545 +0000 UTC m=+28.904416376" watchObservedRunningTime="2026-07-21 20:14:42.646348237 +0000 UTC m=+28.905139152"
Jul 21 20:14:43.610644 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:43.610459    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:43.625840 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:43.625814    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:14:44.048073 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:44.048033    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfxkp"]
Jul 21 20:14:44.048269 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:44.048169    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:44.048269 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:44.048251    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:44.053955 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:44.053924    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8fjh"]
Jul 21 20:14:44.054205 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:44.054041    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:44.054205 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:44.054144    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:44.055223 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:44.055197    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fg49f"]
Jul 21 20:14:44.055325 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:44.055306    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:44.055465 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:44.055421    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:44.614574 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:44.614540    2541 generic.go:356] "Generic (PLEG): container finished" podID="3c00aa3f-d728-4277-8963-35c4c74467d2" containerID="5acf852ca331c85c568fd7309fed2a321721851e41bcc20198c630377e66b905" exitCode=0
Jul 21 20:14:44.615049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:44.614627    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxh7q" event={"ID":"3c00aa3f-d728-4277-8963-35c4c74467d2","Type":"ContainerDied","Data":"5acf852ca331c85c568fd7309fed2a321721851e41bcc20198c630377e66b905"}
Jul 21 20:14:45.287881 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:45.287846    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:45.288047 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:45.287965    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:46.287021 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:46.286858    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:46.287365 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:46.286914    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:46.287365 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:46.287096    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:46.287365 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:46.287172    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:46.621360 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:46.621329    2541 generic.go:356] "Generic (PLEG): container finished" podID="3c00aa3f-d728-4277-8963-35c4c74467d2" containerID="d1ad183ff052981b1b3582ecb2b66992266c74e591d8abc77a4d6e8955cf4757" exitCode=0
Jul 21 20:14:46.621563 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:46.621394    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxh7q" event={"ID":"3c00aa3f-d728-4277-8963-35c4c74467d2","Type":"ContainerDied","Data":"d1ad183ff052981b1b3582ecb2b66992266c74e591d8abc77a4d6e8955cf4757"}
Jul 21 20:14:47.287450 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:47.287398    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:47.287873 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:47.287564    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:47.898643 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:47.898597    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:47.898815 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:47.898762    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:47.898885 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:47.898844    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:15:19.89882253 +0000 UTC m=+66.157613450 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:47.999564 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:47.999466    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:47.999714 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:47.999599    2541 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:47.999714 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:47.999680    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret podName:849977c0-4669-47fa-ac22-45fa370aadf4 nodeName:}" failed. No retries permitted until 2026-07-21 20:15:19.999657509 +0000 UTC m=+66.258448428 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret") pod "global-pull-secret-syncer-xfxkp" (UID: "849977c0-4669-47fa-ac22-45fa370aadf4") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:48.100023 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:48.099981    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:48.100230 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:48.100158    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:48.100230 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:48.100184    2541 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:48.100230 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:48.100196    2541 projected.go:196] Error preparing data for projected volume kube-api-access-gd547 for pod openshift-network-diagnostics/network-check-target-p8fjh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:48.100380 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:48.100262    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547 podName:254e9344-0bc6-44eb-99ef-8b3474648596 nodeName:}" failed. No retries permitted until 2026-07-21 20:15:20.100242425 +0000 UTC m=+66.359033358 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gd547" (UniqueName: "kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547") pod "network-check-target-p8fjh" (UID: "254e9344-0bc6-44eb-99ef-8b3474648596") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:48.287970 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:48.287937    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:48.288422 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:48.288062    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8fjh" podUID="254e9344-0bc6-44eb-99ef-8b3474648596"
Jul 21 20:14:48.288422 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:48.287937    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:48.288422 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:48.288312    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfxkp" podUID="849977c0-4669-47fa-ac22-45fa370aadf4"
Jul 21 20:14:49.287515 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.287476    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:49.287696 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:49.287592    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:14:49.584775 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.584699    2541 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeReady"
Jul 21 20:14:49.585270 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.584865    2541 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 20:14:49.653578 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.652731    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-klr2q"]
Jul 21 20:14:49.655121 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.655085    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.658155 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.657971    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 20:14:49.658310 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.658292    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v6nlp\""
Jul 21 20:14:49.658597 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.658574    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 20:14:49.663634 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.663612    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lmjmb"]
Jul 21 20:14:49.665298 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.665280    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lmjmb"
Jul 21 20:14:49.667938 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.667920    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t5nj5\""
Jul 21 20:14:49.668031 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.667982    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 20:14:49.668250 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.668224    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 20:14:49.669110 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.669084    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 20:14:49.673118 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.673100    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-klr2q"]
Jul 21 20:14:49.681786 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.681735    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lmjmb"]
Jul 21 20:14:49.813863 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.813801    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aad44d0-5d2a-4509-a66d-b232620d3c9c-tmp-dir\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.814029 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.813874    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vv55\" (UniqueName: \"kubernetes.io/projected/7aad44d0-5d2a-4509-a66d-b232620d3c9c-kube-api-access-8vv55\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.814029 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.813926    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16c2289e-1962-4e31-97b8-8b7eb397288c-cert\") pod \"ingress-canary-lmjmb\" (UID: \"16c2289e-1962-4e31-97b8-8b7eb397288c\") " pod="openshift-ingress-canary/ingress-canary-lmjmb"
Jul 21 20:14:49.814120 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.814028    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7aad44d0-5d2a-4509-a66d-b232620d3c9c-config-volume\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.814166 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.814115    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.814166 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.814151    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qspp4\" (UniqueName: \"kubernetes.io/projected/16c2289e-1962-4e31-97b8-8b7eb397288c-kube-api-access-qspp4\") pod \"ingress-canary-lmjmb\" (UID: \"16c2289e-1962-4e31-97b8-8b7eb397288c\") " pod="openshift-ingress-canary/ingress-canary-lmjmb"
Jul 21 20:14:49.915201 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.915122    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aad44d0-5d2a-4509-a66d-b232620d3c9c-tmp-dir\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.915201 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.915168    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vv55\" (UniqueName: \"kubernetes.io/projected/7aad44d0-5d2a-4509-a66d-b232620d3c9c-kube-api-access-8vv55\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.915201 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.915192    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16c2289e-1962-4e31-97b8-8b7eb397288c-cert\") pod \"ingress-canary-lmjmb\" (UID: \"16c2289e-1962-4e31-97b8-8b7eb397288c\") " pod="openshift-ingress-canary/ingress-canary-lmjmb"
Jul 21 20:14:49.915496 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.915216    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7aad44d0-5d2a-4509-a66d-b232620d3c9c-config-volume\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.915496 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.915460    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.915496 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.915491    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qspp4\" (UniqueName: \"kubernetes.io/projected/16c2289e-1962-4e31-97b8-8b7eb397288c-kube-api-access-qspp4\") pod \"ingress-canary-lmjmb\" (UID: \"16c2289e-1962-4e31-97b8-8b7eb397288c\") " pod="openshift-ingress-canary/ingress-canary-lmjmb"
Jul 21 20:14:49.915637 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.915571    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aad44d0-5d2a-4509-a66d-b232620d3c9c-tmp-dir\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.915637 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:49.915611    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:49.915733 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:49.915665    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls podName:7aad44d0-5d2a-4509-a66d-b232620d3c9c nodeName:}" failed. No retries permitted until 2026-07-21 20:14:50.415649083 +0000 UTC m=+36.674439989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls") pod "dns-default-klr2q" (UID: "7aad44d0-5d2a-4509-a66d-b232620d3c9c") : secret "dns-default-metrics-tls" not found
Jul 21 20:14:49.915867 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.915846    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7aad44d0-5d2a-4509-a66d-b232620d3c9c-config-volume\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.920545 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.920522    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16c2289e-1962-4e31-97b8-8b7eb397288c-cert\") pod \"ingress-canary-lmjmb\" (UID: \"16c2289e-1962-4e31-97b8-8b7eb397288c\") " pod="openshift-ingress-canary/ingress-canary-lmjmb"
Jul 21 20:14:49.939256 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.939179    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qspp4\" (UniqueName: \"kubernetes.io/projected/16c2289e-1962-4e31-97b8-8b7eb397288c-kube-api-access-qspp4\") pod \"ingress-canary-lmjmb\" (UID: \"16c2289e-1962-4e31-97b8-8b7eb397288c\") " pod="openshift-ingress-canary/ingress-canary-lmjmb"
Jul 21 20:14:49.939256 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.939218    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vv55\" (UniqueName: \"kubernetes.io/projected/7aad44d0-5d2a-4509-a66d-b232620d3c9c-kube-api-access-8vv55\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:49.975164 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:49.975139    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lmjmb"
Jul 21 20:14:50.287561 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:50.287528    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:14:50.287707 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:50.287529    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:14:50.290749 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:50.290567    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 20:14:50.291051 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:50.291035    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 20:14:50.291206 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:50.291194    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 20:14:50.291343 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:50.291331    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7b7qw\""
Jul 21 20:14:50.419011 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:50.418977    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:50.419181 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:50.419116    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:50.419238 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:50.419193    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls podName:7aad44d0-5d2a-4509-a66d-b232620d3c9c nodeName:}" failed. No retries permitted until 2026-07-21 20:14:51.41917252 +0000 UTC m=+37.677963446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls") pod "dns-default-klr2q" (UID: "7aad44d0-5d2a-4509-a66d-b232620d3c9c") : secret "dns-default-metrics-tls" not found
Jul 21 20:14:50.964701 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:50.964527    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lmjmb"]
Jul 21 20:14:50.968841 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:14:50.968811    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c2289e_1962_4e31_97b8_8b7eb397288c.slice/crio-15cf311e11b7999faf532954eb353c7423e4ea439b623b32e2c1ddaa28963ea2 WatchSource:0}: Error finding container 15cf311e11b7999faf532954eb353c7423e4ea439b623b32e2c1ddaa28963ea2: Status 404 returned error can't find the container with id 15cf311e11b7999faf532954eb353c7423e4ea439b623b32e2c1ddaa28963ea2
Jul 21 20:14:51.287567 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:51.287534    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:14:51.290714 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:51.290699    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bxdt9\""
Jul 21 20:14:51.291245 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:51.291231    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 20:14:51.426911 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:51.426881    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:51.427076 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:51.427048    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:51.427135 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:51.427114    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls podName:7aad44d0-5d2a-4509-a66d-b232620d3c9c nodeName:}" failed. No retries permitted until 2026-07-21 20:14:53.427097678 +0000 UTC m=+39.685888585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls") pod "dns-default-klr2q" (UID: "7aad44d0-5d2a-4509-a66d-b232620d3c9c") : secret "dns-default-metrics-tls" not found
Jul 21 20:14:51.636760 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:51.636667    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lmjmb" event={"ID":"16c2289e-1962-4e31-97b8-8b7eb397288c","Type":"ContainerStarted","Data":"15cf311e11b7999faf532954eb353c7423e4ea439b623b32e2c1ddaa28963ea2"}
Jul 21 20:14:51.639711 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:51.639682    2541 generic.go:356] "Generic (PLEG): container finished" podID="3c00aa3f-d728-4277-8963-35c4c74467d2" containerID="00e2485c8e5414f4d1aa51ae81b5fd3703a14fdeb2e4eb0e0bd9af4faab2fef4" exitCode=0
Jul 21 20:14:51.639831 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:51.639727    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxh7q" event={"ID":"3c00aa3f-d728-4277-8963-35c4c74467d2","Type":"ContainerDied","Data":"00e2485c8e5414f4d1aa51ae81b5fd3703a14fdeb2e4eb0e0bd9af4faab2fef4"}
Jul 21 20:14:52.645719 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:52.645669    2541 generic.go:356] "Generic (PLEG): container finished" podID="3c00aa3f-d728-4277-8963-35c4c74467d2" containerID="863dee7c27207e63a8bf022909b289236b7967bf7c4b092e1ec88b104615596c" exitCode=0
Jul 21 20:14:52.646269 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:52.645742    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxh7q" event={"ID":"3c00aa3f-d728-4277-8963-35c4c74467d2","Type":"ContainerDied","Data":"863dee7c27207e63a8bf022909b289236b7967bf7c4b092e1ec88b104615596c"}
Jul 21 20:14:53.444574 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:53.444308    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:53.444744 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:53.444484    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:53.444744 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:53.444676    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls podName:7aad44d0-5d2a-4509-a66d-b232620d3c9c nodeName:}" failed. No retries permitted until 2026-07-21 20:14:57.444660656 +0000 UTC m=+43.703451575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls") pod "dns-default-klr2q" (UID: "7aad44d0-5d2a-4509-a66d-b232620d3c9c") : secret "dns-default-metrics-tls" not found
Jul 21 20:14:53.649652 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:53.649611    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lmjmb" event={"ID":"16c2289e-1962-4e31-97b8-8b7eb397288c","Type":"ContainerStarted","Data":"99a4ff77fb0217958dc7d0db52352dde947ad4c4e2fa04f77ed44fa23956a5c6"}
Jul 21 20:14:53.653057 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:53.653033    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxh7q" event={"ID":"3c00aa3f-d728-4277-8963-35c4c74467d2","Type":"ContainerStarted","Data":"bc959ff7244a66f0d1656c87965c61379b64f618cc585c78965ed077936b9455"}
Jul 21 20:14:53.667658 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:53.667603    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lmjmb" podStartSLOduration=2.393439019 podStartE2EDuration="4.667586522s" totalImagesPullingTime="2.274147503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:53.666869157 +0000 UTC m=+39.925660083" watchObservedRunningTime="2026-07-21 20:14:53.667586522 +0000 UTC m=+39.926377476"
Jul 21 20:14:53.696680 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:53.696631    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jxh7q" podStartSLOduration=9.646497352 podStartE2EDuration="39.696611891s" totalImagesPullingTime="30.050114539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:53.694140704 +0000 UTC m=+39.952931629" watchObservedRunningTime="2026-07-21 20:14:53.696611891 +0000 UTC m=+39.955402815"
Jul 21 20:14:57.472603 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:14:57.472557    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:14:57.473123 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:57.472713    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:57.473123 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:14:57.472787    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls podName:7aad44d0-5d2a-4509-a66d-b232620d3c9c nodeName:}" failed. No retries permitted until 2026-07-21 20:15:05.472772564 +0000 UTC m=+51.731563470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls") pod "dns-default-klr2q" (UID: "7aad44d0-5d2a-4509-a66d-b232620d3c9c") : secret "dns-default-metrics-tls" not found
Jul 21 20:15:05.529540 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:05.529496    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:15:05.530038 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:15:05.529611    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:15:05.530038 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:15:05.529666    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls podName:7aad44d0-5d2a-4509-a66d-b232620d3c9c nodeName:}" failed. No retries permitted until 2026-07-21 20:15:21.529652086 +0000 UTC m=+67.788442991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls") pod "dns-default-klr2q" (UID: "7aad44d0-5d2a-4509-a66d-b232620d3c9c") : secret "dns-default-metrics-tls" not found
Jul 21 20:15:15.634864 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:15.634828    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2q9sv"
Jul 21 20:15:19.924247 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:19.924199    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:15:19.926981 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:19.926961    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 20:15:19.934989 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:15:19.934965    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 20:15:19.935086 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:15:19.935046    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:16:23.935025039 +0000 UTC m=+130.193815954 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : secret "metrics-daemon-secret" not found
Jul 21 20:15:20.025193 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.025136    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:15:20.027926 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.027907    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 20:15:20.040020 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.039994    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/849977c0-4669-47fa-ac22-45fa370aadf4-original-pull-secret\") pod \"global-pull-secret-syncer-xfxkp\" (UID: \"849977c0-4669-47fa-ac22-45fa370aadf4\") " pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:15:20.125881 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.125838    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:15:20.128481 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.128463    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 20:15:20.138176 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.138158    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 20:15:20.149211 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.149191    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd547\" (UniqueName: \"kubernetes.io/projected/254e9344-0bc6-44eb-99ef-8b3474648596-kube-api-access-gd547\") pod \"network-check-target-p8fjh\" (UID: \"254e9344-0bc6-44eb-99ef-8b3474648596\") " pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:15:20.301582 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.301552    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7b7qw\""
Jul 21 20:15:20.305584 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.305567    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfxkp"
Jul 21 20:15:20.309228 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.309197    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:15:20.442385 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.442353    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfxkp"]
Jul 21 20:15:20.455114 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.455089    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8fjh"]
Jul 21 20:15:20.458098 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:15:20.458073    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254e9344_0bc6_44eb_99ef_8b3474648596.slice/crio-3bff2f4f622cb6546df81c55376dd42aaf6caee3d1e059301c891980e7ba8bdf WatchSource:0}: Error finding container 3bff2f4f622cb6546df81c55376dd42aaf6caee3d1e059301c891980e7ba8bdf: Status 404 returned error can't find the container with id 3bff2f4f622cb6546df81c55376dd42aaf6caee3d1e059301c891980e7ba8bdf
Jul 21 20:15:20.714699 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.714610    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8fjh" event={"ID":"254e9344-0bc6-44eb-99ef-8b3474648596","Type":"ContainerStarted","Data":"3bff2f4f622cb6546df81c55376dd42aaf6caee3d1e059301c891980e7ba8bdf"}
Jul 21 20:15:20.715572 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:20.715553    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfxkp" event={"ID":"849977c0-4669-47fa-ac22-45fa370aadf4","Type":"ContainerStarted","Data":"7a5492e7e4742936bd179fbfcb18bed0b8f0037bf72786c1096a2b9fa806ad15"}
Jul 21 20:15:21.537104 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:21.537060    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:15:21.537598 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:15:21.537211    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:15:21.537598 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:15:21.537274    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls podName:7aad44d0-5d2a-4509-a66d-b232620d3c9c nodeName:}" failed. No retries permitted until 2026-07-21 20:15:53.537253866 +0000 UTC m=+99.796044782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls") pod "dns-default-klr2q" (UID: "7aad44d0-5d2a-4509-a66d-b232620d3c9c") : secret "dns-default-metrics-tls" not found
Jul 21 20:15:25.730875 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:25.730837    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8fjh" event={"ID":"254e9344-0bc6-44eb-99ef-8b3474648596","Type":"ContainerStarted","Data":"77ebd7b7671d389f663f90dce71adfdb142c2cc4d5ac027b543407658a0283cf"}
Jul 21 20:15:25.731370 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:25.730957    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:15:25.732426 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:25.732400    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfxkp" event={"ID":"849977c0-4669-47fa-ac22-45fa370aadf4","Type":"ContainerStarted","Data":"637513b53512f2071698422665a6d1a511dc5b89ca07025b6aa0e633b8e163e8"}
Jul 21 20:15:25.748053 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:25.747987    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p8fjh" podStartSLOduration=66.962363056 podStartE2EDuration="1m11.747974979s" totalImagesPullingTime="4.785611923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:25.747171289 +0000 UTC m=+72.005962236" watchObservedRunningTime="2026-07-21 20:15:25.747974979 +0000 UTC m=+72.006765903"
Jul 21 20:15:25.763796 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:25.763745    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xfxkp" podStartSLOduration=66.961296898 podStartE2EDuration="1m11.763730782s" totalImagesPullingTime="4.802433884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:25.763258379 +0000 UTC m=+72.022049304" watchObservedRunningTime="2026-07-21 20:15:25.763730782 +0000 UTC m=+72.022521706"
Jul 21 20:15:35.370151 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.370033    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"]
Jul 21 20:15:35.372848 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.372826    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.373182 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.373164    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"]
Jul 21 20:15:35.375329 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.375310    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 21 20:15:35.375722 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.375706    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.375786 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.375746    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 20:15:35.375894 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.375854    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 20:15:35.376239 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.376224    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 20:15:35.377866 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.377851    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 20:15:35.378096 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.378077    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 20:15:35.378096 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.378090    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 20:15:35.378558 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.378543    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 20:15:35.386238 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.386191    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"]
Jul 21 20:15:35.388391 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.388370    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"]
Jul 21 20:15:35.438167 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.438136    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-hub\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.438293 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.438173    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/32467071-3d01-48e9-a25e-cd7faf10e8a7-klusterlet-config\") pod \"klusterlet-addon-workmgr-6dc8ff6b77-g2t8n\" (UID: \"32467071-3d01-48e9-a25e-cd7faf10e8a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.438293 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.438191    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f66cf1b8-d754-4b80-97c4-38cb04576750-additional-service-ca\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.438293 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.438274    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.438390 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.438331    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw6jc\" (UniqueName: \"kubernetes.io/projected/f66cf1b8-d754-4b80-97c4-38cb04576750-kube-api-access-dw6jc\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.438390 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.438357    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-ca\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.438390 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.438388    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32467071-3d01-48e9-a25e-cd7faf10e8a7-tmp\") pod \"klusterlet-addon-workmgr-6dc8ff6b77-g2t8n\" (UID: \"32467071-3d01-48e9-a25e-cd7faf10e8a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.438505 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.438411    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npfwc\" (UniqueName: \"kubernetes.io/projected/32467071-3d01-48e9-a25e-cd7faf10e8a7-kube-api-access-npfwc\") pod \"klusterlet-addon-workmgr-6dc8ff6b77-g2t8n\" (UID: \"32467071-3d01-48e9-a25e-cd7faf10e8a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.438505 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.438454    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.539667 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.539621    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32467071-3d01-48e9-a25e-cd7faf10e8a7-tmp\") pod \"klusterlet-addon-workmgr-6dc8ff6b77-g2t8n\" (UID: \"32467071-3d01-48e9-a25e-cd7faf10e8a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.539776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.539678    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npfwc\" (UniqueName: \"kubernetes.io/projected/32467071-3d01-48e9-a25e-cd7faf10e8a7-kube-api-access-npfwc\") pod \"klusterlet-addon-workmgr-6dc8ff6b77-g2t8n\" (UID: \"32467071-3d01-48e9-a25e-cd7faf10e8a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.539866 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.539847    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.539900 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.539882    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-hub\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.539950 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.539911    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/32467071-3d01-48e9-a25e-cd7faf10e8a7-klusterlet-config\") pod \"klusterlet-addon-workmgr-6dc8ff6b77-g2t8n\" (UID: \"32467071-3d01-48e9-a25e-cd7faf10e8a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.539950 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.539934    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f66cf1b8-d754-4b80-97c4-38cb04576750-additional-service-ca\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.540049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.540007    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.540049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.540039    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw6jc\" (UniqueName: \"kubernetes.io/projected/f66cf1b8-d754-4b80-97c4-38cb04576750-kube-api-access-dw6jc\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.540127 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.540063    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-ca\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.540172 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.540137    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32467071-3d01-48e9-a25e-cd7faf10e8a7-tmp\") pod \"klusterlet-addon-workmgr-6dc8ff6b77-g2t8n\" (UID: \"32467071-3d01-48e9-a25e-cd7faf10e8a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.541017 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.540989    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f66cf1b8-d754-4b80-97c4-38cb04576750-additional-service-ca\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.542534 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.542514    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.542660 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.542633    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-ca\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.542767 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.542690    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/32467071-3d01-48e9-a25e-cd7faf10e8a7-klusterlet-config\") pod \"klusterlet-addon-workmgr-6dc8ff6b77-g2t8n\" (UID: \"32467071-3d01-48e9-a25e-cd7faf10e8a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.542960 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.542943    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-hub\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.543057 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.543037    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f66cf1b8-d754-4b80-97c4-38cb04576750-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.549168 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.549143    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw6jc\" (UniqueName: \"kubernetes.io/projected/f66cf1b8-d754-4b80-97c4-38cb04576750-kube-api-access-dw6jc\") pod \"cluster-proxy-proxy-agent-779fb6f586-pvmpd\" (UID: \"f66cf1b8-d754-4b80-97c4-38cb04576750\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.549260 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.549239    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npfwc\" (UniqueName: \"kubernetes.io/projected/32467071-3d01-48e9-a25e-cd7faf10e8a7-kube-api-access-npfwc\") pod \"klusterlet-addon-workmgr-6dc8ff6b77-g2t8n\" (UID: \"32467071-3d01-48e9-a25e-cd7faf10e8a7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.683092 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.683005    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:35.717454 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.706233    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:15:35.836218 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.836185    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"]
Jul 21 20:15:35.839190 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:15:35.839166    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32467071_3d01_48e9_a25e_cd7faf10e8a7.slice/crio-0145356d3d8f4fa7db39ce55f8f1138e819f53e320c3bd730e8e9dbdda493890 WatchSource:0}: Error finding container 0145356d3d8f4fa7db39ce55f8f1138e819f53e320c3bd730e8e9dbdda493890: Status 404 returned error can't find the container with id 0145356d3d8f4fa7db39ce55f8f1138e819f53e320c3bd730e8e9dbdda493890
Jul 21 20:15:35.856882 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:35.856858    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"]
Jul 21 20:15:35.859348 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:15:35.859310    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf66cf1b8_d754_4b80_97c4_38cb04576750.slice/crio-5b255e388a6ff658a12f899e7f3823c10d0e5dc1571b3db48b1336105baff750 WatchSource:0}: Error finding container 5b255e388a6ff658a12f899e7f3823c10d0e5dc1571b3db48b1336105baff750: Status 404 returned error can't find the container with id 5b255e388a6ff658a12f899e7f3823c10d0e5dc1571b3db48b1336105baff750
Jul 21 20:15:36.761828 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:36.761791    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" event={"ID":"f66cf1b8-d754-4b80-97c4-38cb04576750","Type":"ContainerStarted","Data":"5b255e388a6ff658a12f899e7f3823c10d0e5dc1571b3db48b1336105baff750"}
Jul 21 20:15:36.764174 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:36.764140    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n" event={"ID":"32467071-3d01-48e9-a25e-cd7faf10e8a7","Type":"ContainerStarted","Data":"0145356d3d8f4fa7db39ce55f8f1138e819f53e320c3bd730e8e9dbdda493890"}
Jul 21 20:15:39.774779 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:39.774734    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n" event={"ID":"32467071-3d01-48e9-a25e-cd7faf10e8a7","Type":"ContainerStarted","Data":"4ae1bc89be8e70704c189d3f818eadd2c9189bfdb80d253ee0500c0ca85edf6f"}
Jul 21 20:15:39.775252 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:39.774983    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:39.777018 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:39.776995    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:15:39.799815 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:39.799750    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n" podStartSLOduration=1.195049898 podStartE2EDuration="4.799728217s" totalImagesPullingTime="3.604678319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:39.797889656 +0000 UTC m=+86.056680581" watchObservedRunningTime="2026-07-21 20:15:39.799728217 +0000 UTC m=+86.058519143"
Jul 21 20:15:42.786017 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:42.785980    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" event={"ID":"f66cf1b8-d754-4b80-97c4-38cb04576750","Type":"ContainerStarted","Data":"d0ac607694e585c635cedda18abcdd560f07597a22f5972bd2477fb562f40cfe"}
Jul 21 20:15:42.786017 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:42.786022    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" event={"ID":"f66cf1b8-d754-4b80-97c4-38cb04576750","Type":"ContainerStarted","Data":"fa2fcf422d80ee673bf6d0f57282a02f4d37c72b450d467ff54df41ce00bc97c"}
Jul 21 20:15:42.786445 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:42.786034    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" event={"ID":"f66cf1b8-d754-4b80-97c4-38cb04576750","Type":"ContainerStarted","Data":"b4abc41c17b281c56af0d26dc3920f29b6b4c34d4bb00e1f92dc53b90c62c1cd"}
Jul 21 20:15:42.807228 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:42.807176    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" podStartSLOduration=1.522699404 podStartE2EDuration="7.807159533s" totalImagesPullingTime="6.284460129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:42.805945749 +0000 UTC m=+89.064736673" watchObservedRunningTime="2026-07-21 20:15:42.807159533 +0000 UTC m=+89.065950457"
Jul 21 20:15:53.576602 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:53.576565    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:15:53.576991 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:15:53.576681    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:15:53.576991 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:15:53.576742    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls podName:7aad44d0-5d2a-4509-a66d-b232620d3c9c nodeName:}" failed. No retries permitted until 2026-07-21 20:16:57.576727578 +0000 UTC m=+163.835518484 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls") pod "dns-default-klr2q" (UID: "7aad44d0-5d2a-4509-a66d-b232620d3c9c") : secret "dns-default-metrics-tls" not found
Jul 21 20:15:56.737307 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:15:56.737270    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p8fjh"
Jul 21 20:16:23.986616 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:16:23.986558    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:16:23.987048 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:16:23.986736    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 20:16:23.987048 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:16:23.986803    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:18:25.986785462 +0000 UTC m=+252.245576365 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : secret "metrics-daemon-secret" not found
Jul 21 20:16:52.665881 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:16:52.665837    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-klr2q" podUID="7aad44d0-5d2a-4509-a66d-b232620d3c9c"
Jul 21 20:16:52.980647 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:16:52.980574    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-klr2q"
Jul 21 20:16:54.295831 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:16:54.295794    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:16:57.612716 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:16:57.612668    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:16:57.613118 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:16:57.612829    2541 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:16:57.613118 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:16:57.612896    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls podName:7aad44d0-5d2a-4509-a66d-b232620d3c9c nodeName:}" failed. No retries permitted until 2026-07-21 20:18:59.612879718 +0000 UTC m=+285.871670623 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls") pod "dns-default-klr2q" (UID: "7aad44d0-5d2a-4509-a66d-b232620d3c9c") : secret "dns-default-metrics-tls" not found
Jul 21 20:17:06.287726 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:17:06.287646    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:17:39.775659 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:17:39.775602    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n" podUID="32467071-3d01-48e9-a25e-cd7faf10e8a7" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jul 21 20:17:40.119706 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:17:40.119672    2541 generic.go:356] "Generic (PLEG): container finished" podID="32467071-3d01-48e9-a25e-cd7faf10e8a7" containerID="4ae1bc89be8e70704c189d3f818eadd2c9189bfdb80d253ee0500c0ca85edf6f" exitCode=1
Jul 21 20:17:40.119875 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:17:40.119731    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n" event={"ID":"32467071-3d01-48e9-a25e-cd7faf10e8a7","Type":"ContainerDied","Data":"4ae1bc89be8e70704c189d3f818eadd2c9189bfdb80d253ee0500c0ca85edf6f"}
Jul 21 20:17:40.120055 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:17:40.120042    2541 scope.go:117] "RemoveContainer" containerID="4ae1bc89be8e70704c189d3f818eadd2c9189bfdb80d253ee0500c0ca85edf6f"
Jul 21 20:17:41.124550 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:17:41.124510    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n" event={"ID":"32467071-3d01-48e9-a25e-cd7faf10e8a7","Type":"ContainerStarted","Data":"d5689c15219c99eca347eb6bae136a7da04eafd78d8a5dc376684825bf0053e4"}
Jul 21 20:17:41.125023 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:17:41.124779    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:17:41.125410 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:17:41.125395    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dc8ff6b77-g2t8n"
Jul 21 20:18:20.486887 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.486849    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t7qpd"]
Jul 21 20:18:20.489364 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.489343    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.493233 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.493207    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 20:18:20.493233 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.493207    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 20:18:20.493407 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.493208    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 20:18:20.493407 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.493212    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 20:18:20.493407 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.493306    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7vzqq\""
Jul 21 20:18:20.503358 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.503339    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t7qpd"]
Jul 21 20:18:20.566296 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.566261    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.566427 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.566334    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42d37355-01ab-488b-9500-826ca5f3cce7-data-volume\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.566427 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.566363    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42d37355-01ab-488b-9500-826ca5f3cce7-crio-socket\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.566427 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.566378    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8sp9\" (UniqueName: \"kubernetes.io/projected/42d37355-01ab-488b-9500-826ca5f3cce7-kube-api-access-z8sp9\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.566427 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.566396    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.667473 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.667415    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.667609 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.667502    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42d37355-01ab-488b-9500-826ca5f3cce7-data-volume\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.667609 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.667527    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42d37355-01ab-488b-9500-826ca5f3cce7-crio-socket\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.667609 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.667543    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8sp9\" (UniqueName: \"kubernetes.io/projected/42d37355-01ab-488b-9500-826ca5f3cce7-kube-api-access-z8sp9\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.667609 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:20.667559    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:20.667734 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.667617    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42d37355-01ab-488b-9500-826ca5f3cce7-crio-socket\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.667734 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:20.667630    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:21.167614161 +0000 UTC m=+247.426405064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:20.667734 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.667561    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.667734 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:20.667711    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:20.667863 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:20.667762    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:21.167751878 +0000 UTC m=+247.426542923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:20.667863 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.667847    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42d37355-01ab-488b-9500-826ca5f3cce7-data-volume\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:20.675563 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:20.675542    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8sp9\" (UniqueName: \"kubernetes.io/projected/42d37355-01ab-488b-9500-826ca5f3cce7-kube-api-access-z8sp9\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:21.171065 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:21.171033    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:21.171233 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:21.171089    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:21.171233 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:21.171157    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:21.171233 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:21.171163    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:21.171233 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:21.171209    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:22.171194887 +0000 UTC m=+248.429985790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:21.171233 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:21.171220    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:22.171214821 +0000 UTC m=+248.430005723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:22.178782 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:22.178734    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:22.179216 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:22.178805    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:22.179216 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:22.178857    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:22.179216 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:22.178907    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:22.179216 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:22.178922    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:24.178907326 +0000 UTC m=+250.437698235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:22.179216 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:22.178962    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:24.178948967 +0000 UTC m=+250.437739873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:22.658760 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:22.658735    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-txw4j_bc89a228-d422-40b1-99e3-3aaaa739c6c7/dns-node-resolver/0.log"
Jul 21 20:18:23.459130 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:23.459102    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bmf5j_1ae0a64e-c4e8-48fc-81cf-68955534f595/node-ca/0.log"
Jul 21 20:18:24.193191 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:24.193157    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:24.193363 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:24.193206    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:24.193363 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:24.193282    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:24.193363 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:24.193302    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:24.193363 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:24.193342    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:28.193327462 +0000 UTC m=+254.452118365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:24.193363 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:24.193357    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:28.193351132 +0000 UTC m=+254.452142035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:24.462220 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:24.462133    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lmjmb_16c2289e-1962-4e31-97b8-8b7eb397288c/serve-healthcheck-canary/0.log"
Jul 21 20:18:25.715049 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:25.715008    2541 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" podUID="f66cf1b8-d754-4b80-97c4-38cb04576750" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 21 20:18:26.004033 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:26.003950    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:18:26.004184 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:26.004092    2541 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 20:18:26.004184 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:26.004159    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs podName:652b5972-8788-425f-8c44-478a6f4a071f nodeName:}" failed. No retries permitted until 2026-07-21 20:20:28.00414402 +0000 UTC m=+374.262934922 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs") pod "network-metrics-daemon-fg49f" (UID: "652b5972-8788-425f-8c44-478a6f4a071f") : secret "metrics-daemon-secret" not found
Jul 21 20:18:28.219633 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:28.219591    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:28.220045 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:28.219660    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:28.220045 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:28.219737    2541 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:28.220045 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:28.219752    2541 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:28.220045 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:28.219799    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:36.219784502 +0000 UTC m=+262.478575408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:28.220045 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:28.219819    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls podName:42d37355-01ab-488b-9500-826ca5f3cce7 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:36.219805515 +0000 UTC m=+262.478596418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qpd" (UID: "42d37355-01ab-488b-9500-826ca5f3cce7") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:35.714816 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:35.714733    2541 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" podUID="f66cf1b8-d754-4b80-97c4-38cb04576750" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 21 20:18:36.274695 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:36.274662    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:36.274868 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:36.274716    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:36.275167 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:36.275152    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42d37355-01ab-488b-9500-826ca5f3cce7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:36.277044 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:36.277026    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42d37355-01ab-488b-9500-826ca5f3cce7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qpd\" (UID: \"42d37355-01ab-488b-9500-826ca5f3cce7\") " pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:36.397358 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:36.397303    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t7qpd"
Jul 21 20:18:36.532988 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:36.532916    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t7qpd"]
Jul 21 20:18:36.537732 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:18:36.537707    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d37355_01ab_488b_9500_826ca5f3cce7.slice/crio-dac5a2f754774fe1dec92198f0aa805d5f6a9531698a6acb932b9ad04440dca0 WatchSource:0}: Error finding container dac5a2f754774fe1dec92198f0aa805d5f6a9531698a6acb932b9ad04440dca0: Status 404 returned error can't find the container with id dac5a2f754774fe1dec92198f0aa805d5f6a9531698a6acb932b9ad04440dca0
Jul 21 20:18:37.278680 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:37.278577    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7qpd" event={"ID":"42d37355-01ab-488b-9500-826ca5f3cce7","Type":"ContainerStarted","Data":"dac5a2f754774fe1dec92198f0aa805d5f6a9531698a6acb932b9ad04440dca0"}
Jul 21 20:18:42.295943 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:42.295898    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7qpd" event={"ID":"42d37355-01ab-488b-9500-826ca5f3cce7","Type":"ContainerStarted","Data":"837841cf9b3291e47c3ed60d1d75cd31373da8f9d8aeb3cadf0b094ce4fa9b52"}
Jul 21 20:18:44.928714 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:44.928677    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-tp5h7"]
Jul 21 20:18:44.930349 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:44.930333    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-tp5h7"
Jul 21 20:18:44.933383 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:44.933360    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 20:18:44.933903 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:44.933883    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-q4lqf\""
Jul 21 20:18:44.939723 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:44.939703    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 20:18:44.949091 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:44.949072    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-tp5h7"]
Jul 21 20:18:45.040900 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.040877    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vc46\" (UniqueName: \"kubernetes.io/projected/214dd081-d3cc-4f8e-a11b-82a78823bf11-kube-api-access-5vc46\") pod \"downloads-5bc67dcd46-tp5h7\" (UID: \"214dd081-d3cc-4f8e-a11b-82a78823bf11\") " pod="openshift-console/downloads-5bc67dcd46-tp5h7"
Jul 21 20:18:45.141992 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.141925    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vc46\" (UniqueName: \"kubernetes.io/projected/214dd081-d3cc-4f8e-a11b-82a78823bf11-kube-api-access-5vc46\") pod \"downloads-5bc67dcd46-tp5h7\" (UID: \"214dd081-d3cc-4f8e-a11b-82a78823bf11\") " pod="openshift-console/downloads-5bc67dcd46-tp5h7"
Jul 21 20:18:45.151835 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.151802    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vc46\" (UniqueName: \"kubernetes.io/projected/214dd081-d3cc-4f8e-a11b-82a78823bf11-kube-api-access-5vc46\") pod \"downloads-5bc67dcd46-tp5h7\" (UID: \"214dd081-d3cc-4f8e-a11b-82a78823bf11\") " pod="openshift-console/downloads-5bc67dcd46-tp5h7"
Jul 21 20:18:45.239995 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.239967    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-tp5h7"
Jul 21 20:18:45.307811 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.307778    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7qpd" event={"ID":"42d37355-01ab-488b-9500-826ca5f3cce7","Type":"ContainerStarted","Data":"d781dd090e5e104a628ebca21ed0da409104b555d4f2f6cc4e0149996a87f2ec"}
Jul 21 20:18:45.366511 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.366484    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-tp5h7"]
Jul 21 20:18:45.369415 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:18:45.369391    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214dd081_d3cc_4f8e_a11b_82a78823bf11.slice/crio-44705eae54f7cb5264bb21990257c317ae9bf1cc2b4ea969cd522d4580d100e2 WatchSource:0}: Error finding container 44705eae54f7cb5264bb21990257c317ae9bf1cc2b4ea969cd522d4580d100e2: Status 404 returned error can't find the container with id 44705eae54f7cb5264bb21990257c317ae9bf1cc2b4ea969cd522d4580d100e2
Jul 21 20:18:45.714678 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.714638    2541 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" podUID="f66cf1b8-d754-4b80-97c4-38cb04576750" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 21 20:18:45.714830 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.714722    2541 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd"
Jul 21 20:18:45.715369 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.715329    2541 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d0ac607694e585c635cedda18abcdd560f07597a22f5972bd2477fb562f40cfe"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 21 20:18:45.715501 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:45.715402    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" podUID="f66cf1b8-d754-4b80-97c4-38cb04576750" containerName="service-proxy" containerID="cri-o://d0ac607694e585c635cedda18abcdd560f07597a22f5972bd2477fb562f40cfe" gracePeriod=30
Jul 21 20:18:46.315040 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:46.315002    2541 generic.go:356] "Generic (PLEG): container finished" podID="f66cf1b8-d754-4b80-97c4-38cb04576750" containerID="d0ac607694e585c635cedda18abcdd560f07597a22f5972bd2477fb562f40cfe" exitCode=2
Jul 21 20:18:46.315541 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:46.315094    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" event={"ID":"f66cf1b8-d754-4b80-97c4-38cb04576750","Type":"ContainerDied","Data":"d0ac607694e585c635cedda18abcdd560f07597a22f5972bd2477fb562f40cfe"}
Jul 21 20:18:46.315541 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:46.315132    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-779fb6f586-pvmpd" event={"ID":"f66cf1b8-d754-4b80-97c4-38cb04576750","Type":"ContainerStarted","Data":"f0b6898d2be46fc1e9870a5e2dbfac0abb20c153905ea81b9d45ca9b4778144d"}
Jul 21 20:18:46.317336 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:46.317309    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-tp5h7" event={"ID":"214dd081-d3cc-4f8e-a11b-82a78823bf11","Type":"ContainerStarted","Data":"44705eae54f7cb5264bb21990257c317ae9bf1cc2b4ea969cd522d4580d100e2"}
Jul 21 20:18:49.331780 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:49.331742    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7qpd" event={"ID":"42d37355-01ab-488b-9500-826ca5f3cce7","Type":"ContainerStarted","Data":"3a141f1a7e0e006d001ebb5f20caccc1b13b0034ba2304fcc6295ca2dbbedfb3"}
Jul 21 20:18:49.359553 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:49.359500    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t7qpd" podStartSLOduration=17.199588005 podStartE2EDuration="29.35948059s" totalImagesPullingTime="12.159892585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:18:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:18:49.359121754 +0000 UTC m=+275.617912706" watchObservedRunningTime="2026-07-21 20:18:49.35948059 +0000 UTC m=+275.618271516"
Jul 21 20:18:55.981382 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:18:55.981328    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-klr2q" podUID="7aad44d0-5d2a-4509-a66d-b232620d3c9c"
Jul 21 20:18:56.355148 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:56.354794    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-klr2q"
Jul 21 20:18:59.663294 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:59.663259    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:18:59.666087 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:59.666063    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aad44d0-5d2a-4509-a66d-b232620d3c9c-metrics-tls\") pod \"dns-default-klr2q\" (UID: \"7aad44d0-5d2a-4509-a66d-b232620d3c9c\") " pod="openshift-dns/dns-default-klr2q"
Jul 21 20:18:59.958398 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:59.958321    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v6nlp\""
Jul 21 20:18:59.966819 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:18:59.966791    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-klr2q"
Jul 21 20:19:00.403895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.403862    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hbsrk"]
Jul 21 20:19:00.407593 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.407569    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.410340 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.410309    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xnqx8\""
Jul 21 20:19:00.410764 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.410741    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 20:19:00.410889 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.410747    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 20:19:00.411128 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.411110    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 20:19:00.411888 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.411863    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 20:19:00.411977 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.411864    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 20:19:00.415895 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.412871    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 20:19:00.469255 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.469227    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-tls\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.469460 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.469258    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-textfile\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.469460 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.469286    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-wtmp\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.469460 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.469314    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a5ee90c-7053-4980-b739-04c7854bad15-sys\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.469460 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.469353    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.469687 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.469517    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5ee90c-7053-4980-b739-04c7854bad15-metrics-client-ca\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.469687 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.469588    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.469687 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.469620    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drlq5\" (UniqueName: \"kubernetes.io/projected/2a5ee90c-7053-4980-b739-04c7854bad15-kube-api-access-drlq5\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.469687 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.469654    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a5ee90c-7053-4980-b739-04c7854bad15-root\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.570604 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.570549    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.570786 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.570617    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5ee90c-7053-4980-b739-04c7854bad15-metrics-client-ca\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.570786 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.570676    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.570786 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.570702    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drlq5\" (UniqueName: \"kubernetes.io/projected/2a5ee90c-7053-4980-b739-04c7854bad15-kube-api-access-drlq5\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.570786 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.570736    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a5ee90c-7053-4980-b739-04c7854bad15-root\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.570786 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.570765    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-tls\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.571045 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.570791    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-textfile\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.571099 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.571036    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-wtmp\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.571151 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.571095    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a5ee90c-7053-4980-b739-04c7854bad15-sys\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.571151 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.571102    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-textfile\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.571151 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.571115    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a5ee90c-7053-4980-b739-04c7854bad15-root\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.571298 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.571171    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a5ee90c-7053-4980-b739-04c7854bad15-sys\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.571298 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.571209    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-wtmp\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.571298 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.571279    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5ee90c-7053-4980-b739-04c7854bad15-metrics-client-ca\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.571469 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.571304    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.573593 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.573551    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.573753 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.573727    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a5ee90c-7053-4980-b739-04c7854bad15-node-exporter-tls\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.584333 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.584314    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drlq5\" (UniqueName: \"kubernetes.io/projected/2a5ee90c-7053-4980-b739-04c7854bad15-kube-api-access-drlq5\") pod \"node-exporter-hbsrk\" (UID: \"2a5ee90c-7053-4980-b739-04c7854bad15\") " pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:00.720799 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:00.720730    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hbsrk"
Jul 21 20:19:01.828035 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:19:01.828007    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5ee90c_7053_4980_b739_04c7854bad15.slice/crio-a3284ff09e207f2e0c704608f6c9b614c17291ccdc6520ed81c4bb7123652abf WatchSource:0}: Error finding container a3284ff09e207f2e0c704608f6c9b614c17291ccdc6520ed81c4bb7123652abf: Status 404 returned error can't find the container with id a3284ff09e207f2e0c704608f6c9b614c17291ccdc6520ed81c4bb7123652abf
Jul 21 20:19:01.948487 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:01.948461    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-klr2q"]
Jul 21 20:19:01.951614 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:19:01.951586    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aad44d0_5d2a_4509_a66d_b232620d3c9c.slice/crio-a0f05a78657de885ed72d86c1b0252bc69583abf590570a6209bf282d507863a WatchSource:0}: Error finding container a0f05a78657de885ed72d86c1b0252bc69583abf590570a6209bf282d507863a: Status 404 returned error can't find the container with id a0f05a78657de885ed72d86c1b0252bc69583abf590570a6209bf282d507863a
Jul 21 20:19:02.376456 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:02.376402    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbsrk" event={"ID":"2a5ee90c-7053-4980-b739-04c7854bad15","Type":"ContainerStarted","Data":"a3284ff09e207f2e0c704608f6c9b614c17291ccdc6520ed81c4bb7123652abf"}
Jul 21 20:19:02.379617 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:02.378879    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-tp5h7" event={"ID":"214dd081-d3cc-4f8e-a11b-82a78823bf11","Type":"ContainerStarted","Data":"d1fd13ca1670b60904b2eeac773094da80b039282885e73f7b4514de763b9021"}
Jul 21 20:19:02.379617 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:02.379419    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-tp5h7"
Jul 21 20:19:02.381282 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:02.381207    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-klr2q" event={"ID":"7aad44d0-5d2a-4509-a66d-b232620d3c9c","Type":"ContainerStarted","Data":"a0f05a78657de885ed72d86c1b0252bc69583abf590570a6209bf282d507863a"}
Jul 21 20:19:02.391533 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:02.391452    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-tp5h7"
Jul 21 20:19:02.407070 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:02.406949    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-tp5h7" podStartSLOduration=1.846921957 podStartE2EDuration="18.406929907s" totalImagesPullingTime="16.56000795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:19:02.405808044 +0000 UTC m=+288.664598970" watchObservedRunningTime="2026-07-21 20:19:02.406929907 +0000 UTC m=+288.665720833"
Jul 21 20:19:03.387876 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.387745    2541 generic.go:356] "Generic (PLEG): container finished" podID="2a5ee90c-7053-4980-b739-04c7854bad15" containerID="a44e09e59aac98575352f3667fe83df28565446e33a9a76e633b11054f5eef4b" exitCode=0
Jul 21 20:19:03.387876 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.387789    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbsrk" event={"ID":"2a5ee90c-7053-4980-b739-04c7854bad15","Type":"ContainerDied","Data":"a44e09e59aac98575352f3667fe83df28565446e33a9a76e633b11054f5eef4b"}
Jul 21 20:19:03.445490 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.443947    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"]
Jul 21 20:19:03.462141 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.462109    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.465062 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.465034    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 20:19:03.465455 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.465294    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 20:19:03.465686 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.465664    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dnng3gtomp62e\""
Jul 21 20:19:03.465795 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.465738    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 20:19:03.466088 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.466062    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-q8v24\""
Jul 21 20:19:03.466088 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.466121    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 20:19:03.466650 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.466336    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 20:19:03.466650 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.466447    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"]
Jul 21 20:19:03.498873 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.498848    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-grpc-tls\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.499021 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.498897    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwcxt\" (UniqueName: \"kubernetes.io/projected/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-kube-api-access-bwcxt\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.499662 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.499223    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.499662 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.499280    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.499662 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.499311    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-tls\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.499662 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.499350    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.499662 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.499516    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-metrics-client-ca\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.499662 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.499556    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.600744 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.600676    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-metrics-client-ca\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.600744 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.600732    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.601189 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.600783    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-grpc-tls\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.601189 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.600812    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwcxt\" (UniqueName: \"kubernetes.io/projected/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-kube-api-access-bwcxt\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.601189 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.600859    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.601189 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.600896    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.601189 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.600923    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-tls\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.601189 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.600950    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.602089 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.602064    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-metrics-client-ca\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.606344 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.606290    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.606474 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.606425    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.608070 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.608047    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-tls\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.608776 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.608751    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.608951 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.608932    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-grpc-tls\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.610021 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.609998    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.611222 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.611181    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwcxt\" (UniqueName: \"kubernetes.io/projected/2d9e1f32-b309-46e4-b9e3-5ed70904d6f5-kube-api-access-bwcxt\") pod \"thanos-querier-66fbcd4d7-cc72q\" (UID: \"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5\") " pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:03.778476 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:03.778384    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:04.140089 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:04.138865    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"]
Jul 21 20:19:04.268756 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:19:04.268713    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9e1f32_b309_46e4_b9e3_5ed70904d6f5.slice/crio-8f2bad9011ff1a8a1eeb36becef47b8611de33ad52e99ee1b39a5c19fe613ff2 WatchSource:0}: Error finding container 8f2bad9011ff1a8a1eeb36becef47b8611de33ad52e99ee1b39a5c19fe613ff2: Status 404 returned error can't find the container with id 8f2bad9011ff1a8a1eeb36becef47b8611de33ad52e99ee1b39a5c19fe613ff2
Jul 21 20:19:04.394154 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:04.394116    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q" event={"ID":"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5","Type":"ContainerStarted","Data":"8f2bad9011ff1a8a1eeb36becef47b8611de33ad52e99ee1b39a5c19fe613ff2"}
Jul 21 20:19:04.396508 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:04.396478    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbsrk" event={"ID":"2a5ee90c-7053-4980-b739-04c7854bad15","Type":"ContainerStarted","Data":"f242941f0756ca600edd795562a2e50b0c06c63af610fdf576da8634396b7406"}
Jul 21 20:19:04.396611 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:04.396540    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbsrk" event={"ID":"2a5ee90c-7053-4980-b739-04c7854bad15","Type":"ContainerStarted","Data":"61139377b8c769382311fd39f723c16e0ee86abf6332805156e96d40d0bba74d"}
Jul 21 20:19:04.416600 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:04.416551    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hbsrk" podStartSLOduration=3.175402306 podStartE2EDuration="4.416534023s" totalImagesPullingTime="1.153203589s" totalInitContainerRuntime="87.928128ms" isStatefulPod=true podCreationTimestamp="2026-07-21 20:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:19:04.415527018 +0000 UTC m=+290.674317944" watchObservedRunningTime="2026-07-21 20:19:04.416534023 +0000 UTC m=+290.675324949"
Jul 21 20:19:05.403934 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:05.403897    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-klr2q" event={"ID":"7aad44d0-5d2a-4509-a66d-b232620d3c9c","Type":"ContainerStarted","Data":"fe36598e39d0043f03685e71c313b7d7ae5b6f43a00de356faa04376ebdf9c62"}
Jul 21 20:19:05.404414 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:05.404018    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-klr2q" event={"ID":"7aad44d0-5d2a-4509-a66d-b232620d3c9c","Type":"ContainerStarted","Data":"3841917bc81b07a4916622780571ecb7e17b3d10676836ea4e4554cc619014dd"}
Jul 21 20:19:05.404414 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:05.404120    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-klr2q"
Jul 21 20:19:05.423390 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:05.423331    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-klr2q" podStartSLOduration=254.084158397 podStartE2EDuration="4m16.423313113s" totalImagesPullingTime="2.339154716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:19:05.421627667 +0000 UTC m=+291.680418595" watchObservedRunningTime="2026-07-21 20:19:05.423313113 +0000 UTC m=+291.682104039"
Jul 21 20:19:07.415522 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:07.415488    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q" event={"ID":"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5","Type":"ContainerStarted","Data":"20986053f7c16e0460f83c442c5a8f169c8d654cca9a31ef3a1f9019c6e0d109"}
Jul 21 20:19:08.422800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:08.422756    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q" event={"ID":"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5","Type":"ContainerStarted","Data":"48b41534bd6e874f9ae72ffb5badd66682bcf5d4fdb94ad4d4b3bde7dc2dfd8b"}
Jul 21 20:19:08.423196 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:08.422835    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q" event={"ID":"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5","Type":"ContainerStarted","Data":"7c2b699e4619059848b491e5f0de9a9ef1171381774b94054c8657b942a341e4"}
Jul 21 20:19:09.288325 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:19:09.288289    2541 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fg49f" podUID="652b5972-8788-425f-8c44-478a6f4a071f"
Jul 21 20:19:09.430918 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:09.430886    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q" event={"ID":"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5","Type":"ContainerStarted","Data":"410bdb07c44e4c25c546f5a44e9a27bf7507097801b979da0205aad3d2e5f9f6"}
Jul 21 20:19:09.431269 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:09.430971    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q" event={"ID":"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5","Type":"ContainerStarted","Data":"c7bba4e4876c29201bf40f21f37f235667c65addeff7f2e3a98ee6e07469b29b"}
Jul 21 20:19:10.438597 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:10.438560    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q" event={"ID":"2d9e1f32-b309-46e4-b9e3-5ed70904d6f5","Type":"ContainerStarted","Data":"fbb0113909143f9c002db19e1a2a96836f49fe5885f247a954e8dae905192480"}
Jul 21 20:19:10.439055 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:10.438709    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:10.463163 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:10.463091    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q" podStartSLOduration=2.9959245880000003 podStartE2EDuration="7.463070608s" totalImagesPullingTime="4.46714602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:19:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:19:10.463062736 +0000 UTC m=+296.721853662" watchObservedRunningTime="2026-07-21 20:19:10.463070608 +0000 UTC m=+296.721861535"
Jul 21 20:19:14.144451 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:14.144403    2541 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 20:19:15.413234 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:15.413206    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-klr2q"
Jul 21 20:19:16.449646 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:16.449620    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66fbcd4d7-cc72q"
Jul 21 20:19:21.287607 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:19:21.287574    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:20:28.046240 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:28.046153    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:20:28.048556 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:28.048539    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/652b5972-8788-425f-8c44-478a6f4a071f-metrics-certs\") pod \"network-metrics-daemon-fg49f\" (UID: \"652b5972-8788-425f-8c44-478a6f4a071f\") " pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:20:28.190624 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:28.190596    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bxdt9\""
Jul 21 20:20:28.198639 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:28.198621    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg49f"
Jul 21 20:20:28.325371 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:28.325296    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fg49f"]
Jul 21 20:20:28.328612 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:20:28.328586    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652b5972_8788_425f_8c44_478a6f4a071f.slice/crio-486540903e2696880ce73fe829dca141190d560e06588c3c05ce3ae98707388a WatchSource:0}: Error finding container 486540903e2696880ce73fe829dca141190d560e06588c3c05ce3ae98707388a: Status 404 returned error can't find the container with id 486540903e2696880ce73fe829dca141190d560e06588c3c05ce3ae98707388a
Jul 21 20:20:28.330341 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:28.330326    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:20:28.692202 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:28.692118    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fg49f" event={"ID":"652b5972-8788-425f-8c44-478a6f4a071f","Type":"ContainerStarted","Data":"486540903e2696880ce73fe829dca141190d560e06588c3c05ce3ae98707388a"}
Jul 21 20:20:29.697217 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:29.697181    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fg49f" event={"ID":"652b5972-8788-425f-8c44-478a6f4a071f","Type":"ContainerStarted","Data":"e502a03c216e97cac0b8d1f4a37f03541643472d88a8111b6a6bbf463bf5921c"}
Jul 21 20:20:29.697636 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:29.697240    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fg49f" event={"ID":"652b5972-8788-425f-8c44-478a6f4a071f","Type":"ContainerStarted","Data":"ceaaf60d4e76e2e8e80b9ba75f530ae0fe552334cbf18658ed6c9bcc5d94a398"}
Jul 21 20:20:29.715994 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:20:29.715942    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fg49f" podStartSLOduration=374.877280196 podStartE2EDuration="6m15.715926525s" totalImagesPullingTime="838.646329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:20:29.714942159 +0000 UTC m=+375.973733089" watchObservedRunningTime="2026-07-21 20:20:29.715926525 +0000 UTC m=+375.974717450"
Jul 21 20:21:58.850257 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:58.850225    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tvd4m"]
Jul 21 20:21:58.852066 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:58.852049    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tvd4m"
Jul 21 20:21:58.854314 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:58.854291    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 20:21:58.855081 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:58.855052    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 20:21:58.855172 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:58.855100    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pwtvg\""
Jul 21 20:21:58.864209 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:58.864186    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tvd4m"]
Jul 21 20:21:58.977486 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:58.977447    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhsr4\" (UniqueName: \"kubernetes.io/projected/67e94394-3372-4750-a11a-574e0e163c3f-kube-api-access-xhsr4\") pod \"cert-manager-55b4d954d5-tvd4m\" (UID: \"67e94394-3372-4750-a11a-574e0e163c3f\") " pod="cert-manager/cert-manager-55b4d954d5-tvd4m"
Jul 21 20:21:58.977486 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:58.977489    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67e94394-3372-4750-a11a-574e0e163c3f-bound-sa-token\") pod \"cert-manager-55b4d954d5-tvd4m\" (UID: \"67e94394-3372-4750-a11a-574e0e163c3f\") " pod="cert-manager/cert-manager-55b4d954d5-tvd4m"
Jul 21 20:21:59.078017 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:59.077971    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhsr4\" (UniqueName: \"kubernetes.io/projected/67e94394-3372-4750-a11a-574e0e163c3f-kube-api-access-xhsr4\") pod \"cert-manager-55b4d954d5-tvd4m\" (UID: \"67e94394-3372-4750-a11a-574e0e163c3f\") " pod="cert-manager/cert-manager-55b4d954d5-tvd4m"
Jul 21 20:21:59.078017 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:59.078022    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67e94394-3372-4750-a11a-574e0e163c3f-bound-sa-token\") pod \"cert-manager-55b4d954d5-tvd4m\" (UID: \"67e94394-3372-4750-a11a-574e0e163c3f\") " pod="cert-manager/cert-manager-55b4d954d5-tvd4m"
Jul 21 20:21:59.088795 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:59.088769    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67e94394-3372-4750-a11a-574e0e163c3f-bound-sa-token\") pod \"cert-manager-55b4d954d5-tvd4m\" (UID: \"67e94394-3372-4750-a11a-574e0e163c3f\") " pod="cert-manager/cert-manager-55b4d954d5-tvd4m"
Jul 21 20:21:59.088948 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:59.088886    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhsr4\" (UniqueName: \"kubernetes.io/projected/67e94394-3372-4750-a11a-574e0e163c3f-kube-api-access-xhsr4\") pod \"cert-manager-55b4d954d5-tvd4m\" (UID: \"67e94394-3372-4750-a11a-574e0e163c3f\") " pod="cert-manager/cert-manager-55b4d954d5-tvd4m"
Jul 21 20:21:59.160946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:59.160854    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tvd4m"
Jul 21 20:21:59.297166 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:59.297144    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tvd4m"]
Jul 21 20:21:59.298757 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:21:59.298735    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67e94394_3372_4750_a11a_574e0e163c3f.slice/crio-0e6ab9c3dc1429a16e192800b8aa9dd01c8009658e1bd10c2ae965dfe58231b8 WatchSource:0}: Error finding container 0e6ab9c3dc1429a16e192800b8aa9dd01c8009658e1bd10c2ae965dfe58231b8: Status 404 returned error can't find the container with id 0e6ab9c3dc1429a16e192800b8aa9dd01c8009658e1bd10c2ae965dfe58231b8
Jul 21 20:21:59.989619 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:21:59.989586    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tvd4m" event={"ID":"67e94394-3372-4750-a11a-574e0e163c3f","Type":"ContainerStarted","Data":"0e6ab9c3dc1429a16e192800b8aa9dd01c8009658e1bd10c2ae965dfe58231b8"}
Jul 21 20:22:03.004825 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:03.004784    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tvd4m" event={"ID":"67e94394-3372-4750-a11a-574e0e163c3f","Type":"ContainerStarted","Data":"77bc88c3229cd2f8c131a9e3b431a5154e24b47caa58d40f75638e3e662eb0ef"}
Jul 21 20:22:03.025342 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:03.025284    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tvd4m" podStartSLOduration=1.879943532 podStartE2EDuration="5.02526724s" totalImagesPullingTime="3.145323708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:22:03.023586246 +0000 UTC m=+469.282377170" watchObservedRunningTime="2026-07-21 20:22:03.02526724 +0000 UTC m=+469.284058164"
Jul 21 20:22:35.189415 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.189382    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"]
Jul 21 20:22:35.195112 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.195093    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.198712 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.198694    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 20:22:35.199293 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.199270    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 20:22:35.199390 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.199270    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 20:22:35.199390 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.199306    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:22:35.199390 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.199275    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 20:22:35.199532 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.199408    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qw48m\""
Jul 21 20:22:35.206442 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.206409    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"]
Jul 21 20:22:35.353536 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.353494    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52fcf9bf-6623-4593-aa67-752bdc00fe54-cert\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.353698 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.353558    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/52fcf9bf-6623-4593-aa67-752bdc00fe54-metrics-cert\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.353698 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.353633    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmkq\" (UniqueName: \"kubernetes.io/projected/52fcf9bf-6623-4593-aa67-752bdc00fe54-kube-api-access-vcmkq\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.353698 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.353671    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/52fcf9bf-6623-4593-aa67-752bdc00fe54-manager-config\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.454990 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.454897    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52fcf9bf-6623-4593-aa67-752bdc00fe54-cert\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.454990 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.454949    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/52fcf9bf-6623-4593-aa67-752bdc00fe54-metrics-cert\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.455191 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.455162    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmkq\" (UniqueName: \"kubernetes.io/projected/52fcf9bf-6623-4593-aa67-752bdc00fe54-kube-api-access-vcmkq\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.455251 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.455218    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/52fcf9bf-6623-4593-aa67-752bdc00fe54-manager-config\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.455936 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.455909    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/52fcf9bf-6623-4593-aa67-752bdc00fe54-manager-config\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.457563 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.457541    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52fcf9bf-6623-4593-aa67-752bdc00fe54-cert\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.457680 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.457657    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/52fcf9bf-6623-4593-aa67-752bdc00fe54-metrics-cert\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.477854 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.477817    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmkq\" (UniqueName: \"kubernetes.io/projected/52fcf9bf-6623-4593-aa67-752bdc00fe54-kube-api-access-vcmkq\") pod \"lws-controller-manager-697fc85fc4-tz9sv\" (UID: \"52fcf9bf-6623-4593-aa67-752bdc00fe54\") " pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.504566 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.504529    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:35.668173 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:35.668138    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"]
Jul 21 20:22:35.671544 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:22:35.671520    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fcf9bf_6623_4593_aa67_752bdc00fe54.slice/crio-a81697dc3ea38cf3645b19deccf2c5548f3086cbacba61e83784a5d425d7013a WatchSource:0}: Error finding container a81697dc3ea38cf3645b19deccf2c5548f3086cbacba61e83784a5d425d7013a: Status 404 returned error can't find the container with id a81697dc3ea38cf3645b19deccf2c5548f3086cbacba61e83784a5d425d7013a
Jul 21 20:22:36.118634 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:36.118602    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv" event={"ID":"52fcf9bf-6623-4593-aa67-752bdc00fe54","Type":"ContainerStarted","Data":"a81697dc3ea38cf3645b19deccf2c5548f3086cbacba61e83784a5d425d7013a"}
Jul 21 20:22:38.384656 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.384564    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"]
Jul 21 20:22:38.386864 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.386842    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.392262 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.392241    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 20:22:38.392382 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.392336    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 20:22:38.392764 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.392750    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 20:22:38.393621 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.393602    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-btdnv\""
Jul 21 20:22:38.396170 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.396152    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 20:22:38.408777 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.408751    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"]
Jul 21 20:22:38.484111 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.484081    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7pg7\" (UniqueName: \"kubernetes.io/projected/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-kube-api-access-b7pg7\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.484281 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.484130    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.484281 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.484194    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-tmp\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.484281 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.484222    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-manifests\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.484382 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.484276    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.585210 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.585172    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.585342 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.585226    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-tmp\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.585379 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.585338    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-manifests\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.585412 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.585397    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.585479 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.585454    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7pg7\" (UniqueName: \"kubernetes.io/projected/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-kube-api-access-b7pg7\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.585741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.585720    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-manifests\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.587661 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.587634    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-tmp\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.587946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.587928    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.588011 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.587934    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.599799 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.599767    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7pg7\" (UniqueName: \"kubernetes.io/projected/645dd1a2-2d04-435e-a1dc-73ca5a7be9af-kube-api-access-b7pg7\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-9mkth\" (UID: \"645dd1a2-2d04-435e-a1dc-73ca5a7be9af\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.697387 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.697288    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:38.874065 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:38.874030    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"]
Jul 21 20:22:38.876139 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:22:38.876113    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645dd1a2_2d04_435e_a1dc_73ca5a7be9af.slice/crio-3663a9a72111531aededcc0edfae749e353ae876a34060f116e49b3bb7d263f2 WatchSource:0}: Error finding container 3663a9a72111531aededcc0edfae749e353ae876a34060f116e49b3bb7d263f2: Status 404 returned error can't find the container with id 3663a9a72111531aededcc0edfae749e353ae876a34060f116e49b3bb7d263f2
Jul 21 20:22:39.133679 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:39.133638    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv" event={"ID":"52fcf9bf-6623-4593-aa67-752bdc00fe54","Type":"ContainerStarted","Data":"d175b8d56470be2438b69ec4b5a7b0edddf8dc3053fe24f7a29b8c9c03351a2c"}
Jul 21 20:22:39.133839 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:39.133701    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:39.135000 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:39.134975    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth" event={"ID":"645dd1a2-2d04-435e-a1dc-73ca5a7be9af","Type":"ContainerStarted","Data":"3663a9a72111531aededcc0edfae749e353ae876a34060f116e49b3bb7d263f2"}
Jul 21 20:22:39.161779 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:39.161737    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv" podStartSLOduration=1.769956594 podStartE2EDuration="4.161723691s" totalImagesPullingTime="2.391767097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:22:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:22:39.160653277 +0000 UTC m=+505.419444203" watchObservedRunningTime="2026-07-21 20:22:39.161723691 +0000 UTC m=+505.420514616"
Jul 21 20:22:42.148824 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:42.148740    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth" event={"ID":"645dd1a2-2d04-435e-a1dc-73ca5a7be9af","Type":"ContainerStarted","Data":"ff2c0de9c401212ed67a9bef9ac0b119248b7418df06d8e6216dd51af3a52699"}
Jul 21 20:22:43.153828 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:43.153793    2541 generic.go:356] "Generic (PLEG): container finished" podID="645dd1a2-2d04-435e-a1dc-73ca5a7be9af" containerID="ff2c0de9c401212ed67a9bef9ac0b119248b7418df06d8e6216dd51af3a52699" exitCode=0
Jul 21 20:22:43.154188 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:43.153874    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth" event={"ID":"645dd1a2-2d04-435e-a1dc-73ca5a7be9af","Type":"ContainerDied","Data":"ff2c0de9c401212ed67a9bef9ac0b119248b7418df06d8e6216dd51af3a52699"}
Jul 21 20:22:44.158998 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:44.158964    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth" event={"ID":"645dd1a2-2d04-435e-a1dc-73ca5a7be9af","Type":"ContainerStarted","Data":"e4b9779c4772e04682e72a98d07d51e59791093eb54f4b2a883c161a948f172f"}
Jul 21 20:22:44.159505 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:44.159087    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:22:44.185922 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:44.185857    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth" podStartSLOduration=1.83326155 podStartE2EDuration="6.185832328s" totalImagesPullingTime="3.258196394s" totalInitContainerRuntime="1.094374384s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:22:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:22:44.182797697 +0000 UTC m=+510.441588644" watchObservedRunningTime="2026-07-21 20:22:44.185832328 +0000 UTC m=+510.444623254"
Jul 21 20:22:50.143921 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:50.143888    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-697fc85fc4-tz9sv"
Jul 21 20:22:55.165003 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:22:55.164969    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-9mkth"
Jul 21 20:23:05.854168 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.854090    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"]
Jul 21 20:23:05.857182 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.857166    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.860501 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:05.860473    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-tls\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret"
Jul 21 20:23:05.861033 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:05.861007    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istio-kubeconfig\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret"
Jul 21 20:23:05.861112 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:05.861056    2541 status_manager.go:1018] "Failed to get status for pod" err="pods \"istiod-openshift-gateway-94bb8fbfd-bmps8\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" podUID="f00ab062-ca61-4ffc-8020-4e830087e17e" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.861112 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:05.861090    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 21 20:23:05.861112 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:05.861095    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-gw-ca-root-cert\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap"
Jul 21 20:23:05.861232 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:05.861101    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 21 20:23:05.861612 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:05.861594    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cacerts\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret"
Jul 21 20:23:05.861856 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:05.861839    2541 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-openshift-gateway-dockercfg-rfwfv\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rfwfv\"" type="*v1.Secret"
Jul 21 20:23:05.870818 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.870797    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.870883 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.870831    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.870883 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.870859    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.870883 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.870873    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8zh7\" (UniqueName: \"kubernetes.io/projected/f00ab062-ca61-4ffc-8020-4e830087e17e-kube-api-access-c8zh7\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.870988 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.870919    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.870988 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.870956    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00ab062-ca61-4ffc-8020-4e830087e17e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.870988 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.870974    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.889718 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.889690    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"]
Jul 21 20:23:05.971704 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.971669    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.971885 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.971711    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.971885 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.971794    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.971885 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.971810    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zh7\" (UniqueName: \"kubernetes.io/projected/f00ab062-ca61-4ffc-8020-4e830087e17e-kube-api-access-c8zh7\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.971885 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.971826    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.971885 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.971843    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00ab062-ca61-4ffc-8020-4e830087e17e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.971885 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.971860    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.974124 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.974095    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00ab062-ca61-4ffc-8020-4e830087e17e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:05.982406 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:05.982388    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:06.842584 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:06.842551    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rfwfv\""
Jul 21 20:23:06.885088 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:06.885062    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 20:23:06.894824 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:06.894797    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:06.972287 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:06.972255    2541 secret.go:189] Couldn't get secret openshift-ingress/cacerts: failed to sync secret cache: timed out waiting for the condition
Jul 21 20:23:06.972287 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:06.972271    2541 configmap.go:193] Couldn't get configMap openshift-ingress/openshift-gw-ca-root-cert: failed to sync configmap cache: timed out waiting for the condition
Jul 21 20:23:06.972497 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:06.972324    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-cacerts podName:f00ab062-ca61-4ffc-8020-4e830087e17e nodeName:}" failed. No retries permitted until 2026-07-21 20:23:07.472306532 +0000 UTC m=+533.731097435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cacerts" (UniqueName: "kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-cacerts") pod "istiod-openshift-gateway-94bb8fbfd-bmps8" (UID: "f00ab062-ca61-4ffc-8020-4e830087e17e") : failed to sync secret cache: timed out waiting for the condition
Jul 21 20:23:06.972497 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:06.972260    2541 secret.go:189] Couldn't get secret openshift-ingress/istiod-tls: failed to sync secret cache: timed out waiting for the condition
Jul 21 20:23:06.972497 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:06.972337    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-ca-configmap podName:f00ab062-ca61-4ffc-8020-4e830087e17e nodeName:}" failed. No retries permitted until 2026-07-21 20:23:07.472331317 +0000 UTC m=+533.731122220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-csr-ca-configmap" (UniqueName: "kubernetes.io/configmap/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-ca-configmap") pod "istiod-openshift-gateway-94bb8fbfd-bmps8" (UID: "f00ab062-ca61-4ffc-8020-4e830087e17e") : failed to sync configmap cache: timed out waiting for the condition
Jul 21 20:23:06.972497 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:06.972358    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-dns-cert podName:f00ab062-ca61-4ffc-8020-4e830087e17e nodeName:}" failed. No retries permitted until 2026-07-21 20:23:07.472344502 +0000 UTC m=+533.731135405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-csr-dns-cert" (UniqueName: "kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-dns-cert") pod "istiod-openshift-gateway-94bb8fbfd-bmps8" (UID: "f00ab062-ca61-4ffc-8020-4e830087e17e") : failed to sync secret cache: timed out waiting for the condition
Jul 21 20:23:06.981102 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:06.981083    2541 projected.go:291] Couldn't get configMap openshift-ingress/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 21 20:23:07.129884 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.129807    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 20:23:07.149221 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.149194    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 20:23:07.200301 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.200274    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 20:23:07.201318 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:07.201302    2541 projected.go:196] Error preparing data for projected volume kube-api-access-c8zh7 for pod openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8: failed to sync configmap cache: timed out waiting for the condition
Jul 21 20:23:07.201395 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:23:07.201368    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f00ab062-ca61-4ffc-8020-4e830087e17e-kube-api-access-c8zh7 podName:f00ab062-ca61-4ffc-8020-4e830087e17e nodeName:}" failed. No retries permitted until 2026-07-21 20:23:07.701354094 +0000 UTC m=+533.960144997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c8zh7" (UniqueName: "kubernetes.io/projected/f00ab062-ca61-4ffc-8020-4e830087e17e-kube-api-access-c8zh7") pod "istiod-openshift-gateway-94bb8fbfd-bmps8" (UID: "f00ab062-ca61-4ffc-8020-4e830087e17e") : failed to sync configmap cache: timed out waiting for the condition
Jul 21 20:23:07.247182 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.247160    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 20:23:07.373780 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.373752    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 20:23:07.486574 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.486494    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:07.486574 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.486550    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:07.486777 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.486723    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:07.487009 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.486977    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:07.489033 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.489016    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:07.489119 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.489035    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f00ab062-ca61-4ffc-8020-4e830087e17e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:07.789324 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.789286    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zh7\" (UniqueName: \"kubernetes.io/projected/f00ab062-ca61-4ffc-8020-4e830087e17e-kube-api-access-c8zh7\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:07.792176 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.792146    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8zh7\" (UniqueName: \"kubernetes.io/projected/f00ab062-ca61-4ffc-8020-4e830087e17e-kube-api-access-c8zh7\") pod \"istiod-openshift-gateway-94bb8fbfd-bmps8\" (UID: \"f00ab062-ca61-4ffc-8020-4e830087e17e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:07.966377 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:07.966325    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:08.115009 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:08.114891    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"]
Jul 21 20:23:08.117504 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:23:08.117481    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00ab062_ca61_4ffc_8020_4e830087e17e.slice/crio-32b460363d00883eb944b9b681f622f919c41e470a74aa4381e7c5f870504b2a WatchSource:0}: Error finding container 32b460363d00883eb944b9b681f622f919c41e470a74aa4381e7c5f870504b2a: Status 404 returned error can't find the container with id 32b460363d00883eb944b9b681f622f919c41e470a74aa4381e7c5f870504b2a
Jul 21 20:23:08.250813 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:08.250777    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8" event={"ID":"f00ab062-ca61-4ffc-8020-4e830087e17e","Type":"ContainerStarted","Data":"32b460363d00883eb944b9b681f622f919c41e470a74aa4381e7c5f870504b2a"}
Jul 21 20:23:10.614029 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:10.613995    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 20:23:10.614315 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:10.614057    2541 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 20:23:11.263978 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:11.263940    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8" event={"ID":"f00ab062-ca61-4ffc-8020-4e830087e17e","Type":"ContainerStarted","Data":"c799ad0687ba28dd192c1d33f7955d0a07ce35bf0e523cd5a70283d9ce80507f"}
Jul 21 20:23:11.264153 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:11.264024    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:23:11.266092 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:11.266065    2541 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-bmps8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 20:23:11.266277 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:11.266258    2541 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8" podUID="f00ab062-ca61-4ffc-8020-4e830087e17e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 20:23:11.292670 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:11.292623    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8" podStartSLOduration=3.798183958 podStartE2EDuration="6.292609017s" totalImagesPullingTime="2.494425059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:23:11.292336417 +0000 UTC m=+537.551127341" watchObservedRunningTime="2026-07-21 20:23:11.292609017 +0000 UTC m=+537.551399942"
Jul 21 20:23:12.268538 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:23:12.268511    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bmps8"
Jul 21 20:25:41.659206 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.659167    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"]
Jul 21 20:25:41.662380 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.662358    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:41.665286 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.665269    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-phzwh\""
Jul 21 20:25:41.665520 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.665508    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 20:25:41.666080 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.666063    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 20:25:41.666386 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.666373    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 20:25:41.683946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.683922    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"]
Jul 21 20:25:41.690901 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.690871    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxbq5\" (UniqueName: \"kubernetes.io/projected/a07a3da1-94a4-4016-a84b-68a7a7e46925-kube-api-access-dxbq5\") pod \"limitador-limitador-64c94fd64f-rnlwq\" (UID: \"a07a3da1-94a4-4016-a84b-68a7a7e46925\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:41.691012 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.690913    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a07a3da1-94a4-4016-a84b-68a7a7e46925-config-file\") pod \"limitador-limitador-64c94fd64f-rnlwq\" (UID: \"a07a3da1-94a4-4016-a84b-68a7a7e46925\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:41.752567 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.752530    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"]
Jul 21 20:25:41.791807 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.791767    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxbq5\" (UniqueName: \"kubernetes.io/projected/a07a3da1-94a4-4016-a84b-68a7a7e46925-kube-api-access-dxbq5\") pod \"limitador-limitador-64c94fd64f-rnlwq\" (UID: \"a07a3da1-94a4-4016-a84b-68a7a7e46925\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:41.791807 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.791809    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a07a3da1-94a4-4016-a84b-68a7a7e46925-config-file\") pod \"limitador-limitador-64c94fd64f-rnlwq\" (UID: \"a07a3da1-94a4-4016-a84b-68a7a7e46925\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:41.792522 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.792496    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a07a3da1-94a4-4016-a84b-68a7a7e46925-config-file\") pod \"limitador-limitador-64c94fd64f-rnlwq\" (UID: \"a07a3da1-94a4-4016-a84b-68a7a7e46925\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:41.809957 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.809928    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxbq5\" (UniqueName: \"kubernetes.io/projected/a07a3da1-94a4-4016-a84b-68a7a7e46925-kube-api-access-dxbq5\") pod \"limitador-limitador-64c94fd64f-rnlwq\" (UID: \"a07a3da1-94a4-4016-a84b-68a7a7e46925\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:41.972691 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:41.972600    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:42.118756 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:42.118621    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"]
Jul 21 20:25:42.121503 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:25:42.121476    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07a3da1_94a4_4016_a84b_68a7a7e46925.slice/crio-b3f243fd6b18dcc0628317b683295ac914550baf539540f6b35b976154f3604d WatchSource:0}: Error finding container b3f243fd6b18dcc0628317b683295ac914550baf539540f6b35b976154f3604d: Status 404 returned error can't find the container with id b3f243fd6b18dcc0628317b683295ac914550baf539540f6b35b976154f3604d
Jul 21 20:25:42.123784 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:42.123765    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:25:42.807935 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:42.807903    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq" event={"ID":"a07a3da1-94a4-4016-a84b-68a7a7e46925","Type":"ContainerStarted","Data":"b3f243fd6b18dcc0628317b683295ac914550baf539540f6b35b976154f3604d"}
Jul 21 20:25:45.822627 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:45.822591    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq" event={"ID":"a07a3da1-94a4-4016-a84b-68a7a7e46925","Type":"ContainerStarted","Data":"508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf"}
Jul 21 20:25:45.823021 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:45.822738    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:45.847753 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:45.847707    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq" podStartSLOduration=2.048191581 podStartE2EDuration="4.847693202s" totalImagesPullingTime="2.799501621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:25:45.845950357 +0000 UTC m=+692.104741295" watchObservedRunningTime="2026-07-21 20:25:45.847693202 +0000 UTC m=+692.106484127"
Jul 21 20:25:56.826800 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:56.826772    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:58.908518 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:58.908485    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"]
Jul 21 20:25:58.908896 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:58.908658    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq" podUID="a07a3da1-94a4-4016-a84b-68a7a7e46925" containerName="limitador" containerID="cri-o://508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf" gracePeriod=30
Jul 21 20:25:59.455876 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.455851    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:59.518141 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.518114    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a07a3da1-94a4-4016-a84b-68a7a7e46925-config-file\") pod \"a07a3da1-94a4-4016-a84b-68a7a7e46925\" (UID: \"a07a3da1-94a4-4016-a84b-68a7a7e46925\") "
Jul 21 20:25:59.518294 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.518175    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxbq5\" (UniqueName: \"kubernetes.io/projected/a07a3da1-94a4-4016-a84b-68a7a7e46925-kube-api-access-dxbq5\") pod \"a07a3da1-94a4-4016-a84b-68a7a7e46925\" (UID: \"a07a3da1-94a4-4016-a84b-68a7a7e46925\") "
Jul 21 20:25:59.518590 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.518564    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07a3da1-94a4-4016-a84b-68a7a7e46925-config-file" (OuterVolumeSpecName: "config-file") pod "a07a3da1-94a4-4016-a84b-68a7a7e46925" (UID: "a07a3da1-94a4-4016-a84b-68a7a7e46925"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:25:59.520494 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.520469    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a07a3da1-94a4-4016-a84b-68a7a7e46925-kube-api-access-dxbq5" (OuterVolumeSpecName: "kube-api-access-dxbq5") pod "a07a3da1-94a4-4016-a84b-68a7a7e46925" (UID: "a07a3da1-94a4-4016-a84b-68a7a7e46925"). InnerVolumeSpecName "kube-api-access-dxbq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:25:59.619642 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.619594    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxbq5\" (UniqueName: \"kubernetes.io/projected/a07a3da1-94a4-4016-a84b-68a7a7e46925-kube-api-access-dxbq5\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:25:59.619642 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.619636    2541 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a07a3da1-94a4-4016-a84b-68a7a7e46925-config-file\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:25:59.873142 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.873052    2541 generic.go:356] "Generic (PLEG): container finished" podID="a07a3da1-94a4-4016-a84b-68a7a7e46925" containerID="508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf" exitCode=0
Jul 21 20:25:59.873142 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.873101    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"
Jul 21 20:25:59.873142 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.873129    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq" event={"ID":"a07a3da1-94a4-4016-a84b-68a7a7e46925","Type":"ContainerDied","Data":"508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf"}
Jul 21 20:25:59.873334 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.873181    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnlwq" event={"ID":"a07a3da1-94a4-4016-a84b-68a7a7e46925","Type":"ContainerDied","Data":"b3f243fd6b18dcc0628317b683295ac914550baf539540f6b35b976154f3604d"}
Jul 21 20:25:59.873334 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.873230    2541 scope.go:117] "RemoveContainer" containerID="508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf"
Jul 21 20:25:59.881786 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.881765    2541 scope.go:117] "RemoveContainer" containerID="508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf"
Jul 21 20:25:59.882054 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:25:59.882032    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf\": container with ID starting with 508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf not found: ID does not exist" containerID="508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf"
Jul 21 20:25:59.882087 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.882063    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf"} err="failed to get container status \"508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf\": rpc error: code = NotFound desc = could not find container \"508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf\": container with ID starting with 508a9cbd5850095e3218dcb10e191a9606b7ad9022d0d5d857b3b3bed9834cdf not found: ID does not exist"
Jul 21 20:25:59.898539 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.898513    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"]
Jul 21 20:25:59.902821 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:25:59.902801    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnlwq"]
Jul 21 20:26:00.291349 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:00.291317    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a07a3da1-94a4-4016-a84b-68a7a7e46925" path="/var/lib/kubelet/pods/a07a3da1-94a4-4016-a84b-68a7a7e46925/volumes"
Jul 21 20:26:03.472012 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.471975    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"]
Jul 21 20:26:03.472458 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.472260    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07a3da1-94a4-4016-a84b-68a7a7e46925" containerName="limitador"
Jul 21 20:26:03.472458 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.472271    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07a3da1-94a4-4016-a84b-68a7a7e46925" containerName="limitador"
Jul 21 20:26:03.472458 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.472317    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="a07a3da1-94a4-4016-a84b-68a7a7e46925" containerName="limitador"
Jul 21 20:26:03.476174 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.476156    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:03.478884 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.478863    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-r456r\""
Jul 21 20:26:03.479288 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.479272    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 20:26:03.479386 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.479366    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 20:26:03.492406 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.492383    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 20:26:03.498494 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.498474    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"]
Jul 21 20:26:03.552286 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.552255    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx66t\" (UniqueName: \"kubernetes.io/projected/3c6c18d1-56ec-4dc3-a8df-6360c0add623-kube-api-access-gx66t\") pod \"postgres-69fb4594cf-n5xp5\" (UID: \"3c6c18d1-56ec-4dc3-a8df-6360c0add623\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:03.552474 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.552351    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3c6c18d1-56ec-4dc3-a8df-6360c0add623-data\") pod \"postgres-69fb4594cf-n5xp5\" (UID: \"3c6c18d1-56ec-4dc3-a8df-6360c0add623\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:03.653491 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.653452    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3c6c18d1-56ec-4dc3-a8df-6360c0add623-data\") pod \"postgres-69fb4594cf-n5xp5\" (UID: \"3c6c18d1-56ec-4dc3-a8df-6360c0add623\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:03.653657 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.653509    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx66t\" (UniqueName: \"kubernetes.io/projected/3c6c18d1-56ec-4dc3-a8df-6360c0add623-kube-api-access-gx66t\") pod \"postgres-69fb4594cf-n5xp5\" (UID: \"3c6c18d1-56ec-4dc3-a8df-6360c0add623\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:03.653780 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.653761    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3c6c18d1-56ec-4dc3-a8df-6360c0add623-data\") pod \"postgres-69fb4594cf-n5xp5\" (UID: \"3c6c18d1-56ec-4dc3-a8df-6360c0add623\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:03.667641 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.667615    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx66t\" (UniqueName: \"kubernetes.io/projected/3c6c18d1-56ec-4dc3-a8df-6360c0add623-kube-api-access-gx66t\") pod \"postgres-69fb4594cf-n5xp5\" (UID: \"3c6c18d1-56ec-4dc3-a8df-6360c0add623\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:03.785535 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.785510    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:03.957832 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:03.957794    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"]
Jul 21 20:26:03.961775 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:26:03.961737    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6c18d1_56ec_4dc3_a8df_6360c0add623.slice/crio-386fe6b6db1f7ae5cac0a6c120e7456a8460dd0f7e7e9dd71e03dfb9c7dfd11e WatchSource:0}: Error finding container 386fe6b6db1f7ae5cac0a6c120e7456a8460dd0f7e7e9dd71e03dfb9c7dfd11e: Status 404 returned error can't find the container with id 386fe6b6db1f7ae5cac0a6c120e7456a8460dd0f7e7e9dd71e03dfb9c7dfd11e
Jul 21 20:26:04.897822 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:04.897619    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5" event={"ID":"3c6c18d1-56ec-4dc3-a8df-6360c0add623","Type":"ContainerStarted","Data":"386fe6b6db1f7ae5cac0a6c120e7456a8460dd0f7e7e9dd71e03dfb9c7dfd11e"}
Jul 21 20:26:09.918785 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:09.918746    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5" event={"ID":"3c6c18d1-56ec-4dc3-a8df-6360c0add623","Type":"ContainerStarted","Data":"584e7d8728ec853dba94b934b983e626a3b668bc25d1260935410939a51225af"}
Jul 21 20:26:09.919205 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:09.918852    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:15.951836 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:15.951809    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5"
Jul 21 20:26:16.006092 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:16.006039    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-n5xp5" podStartSLOduration=8.037456909 podStartE2EDuration="13.006024698s" totalImagesPullingTime="4.968567789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:26:09.941606232 +0000 UTC m=+716.200397176" watchObservedRunningTime="2026-07-21 20:26:16.006024698 +0000 UTC m=+722.264815623"
Jul 21 20:26:23.571296 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.571259    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76d47ddd7d-fk6s5"]
Jul 21 20:26:23.575992 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.575971    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:23.580562 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.580540    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 20:26:23.580675 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.580634    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zk2ck\""
Jul 21 20:26:23.581186 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.581174    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 20:26:23.602006 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.601979    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76d47ddd7d-fk6s5"]
Jul 21 20:26:23.714611 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.714578    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdjn\" (UniqueName: \"kubernetes.io/projected/4540bae7-9d04-4862-b5e9-4db90b06c843-kube-api-access-cxdjn\") pod \"maas-controller-76d47ddd7d-fk6s5\" (UID: \"4540bae7-9d04-4862-b5e9-4db90b06c843\") " pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:23.714793 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.714618    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4540bae7-9d04-4862-b5e9-4db90b06c843-webhook-cert\") pod \"maas-controller-76d47ddd7d-fk6s5\" (UID: \"4540bae7-9d04-4862-b5e9-4db90b06c843\") " pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:23.787078 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.787043    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-f5rv7"]
Jul 21 20:26:23.790364 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.790346    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:23.810546 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.810516    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-f5rv7"]
Jul 21 20:26:23.815313 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.815285    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdjn\" (UniqueName: \"kubernetes.io/projected/4540bae7-9d04-4862-b5e9-4db90b06c843-kube-api-access-cxdjn\") pod \"maas-controller-76d47ddd7d-fk6s5\" (UID: \"4540bae7-9d04-4862-b5e9-4db90b06c843\") " pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:23.815425 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.815327    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4540bae7-9d04-4862-b5e9-4db90b06c843-webhook-cert\") pod \"maas-controller-76d47ddd7d-fk6s5\" (UID: \"4540bae7-9d04-4862-b5e9-4db90b06c843\") " pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:23.817801 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.817774    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4540bae7-9d04-4862-b5e9-4db90b06c843-webhook-cert\") pod \"maas-controller-76d47ddd7d-fk6s5\" (UID: \"4540bae7-9d04-4862-b5e9-4db90b06c843\") " pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:23.829147 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.829095    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdjn\" (UniqueName: \"kubernetes.io/projected/4540bae7-9d04-4862-b5e9-4db90b06c843-kube-api-access-cxdjn\") pod \"maas-controller-76d47ddd7d-fk6s5\" (UID: \"4540bae7-9d04-4862-b5e9-4db90b06c843\") " pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:23.886520 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.886481    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:23.915862 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.915830    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sr7v\" (UniqueName: \"kubernetes.io/projected/2609da42-064c-4904-bfd3-3b1b90101de1-kube-api-access-5sr7v\") pod \"maas-controller-6f5b6f4b86-f5rv7\" (UID: \"2609da42-064c-4904-bfd3-3b1b90101de1\") " pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:23.916024 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:23.915873    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2609da42-064c-4904-bfd3-3b1b90101de1-webhook-cert\") pod \"maas-controller-6f5b6f4b86-f5rv7\" (UID: \"2609da42-064c-4904-bfd3-3b1b90101de1\") " pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:24.017123 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:24.017090    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sr7v\" (UniqueName: \"kubernetes.io/projected/2609da42-064c-4904-bfd3-3b1b90101de1-kube-api-access-5sr7v\") pod \"maas-controller-6f5b6f4b86-f5rv7\" (UID: \"2609da42-064c-4904-bfd3-3b1b90101de1\") " pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:24.017123 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:24.017130    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2609da42-064c-4904-bfd3-3b1b90101de1-webhook-cert\") pod \"maas-controller-6f5b6f4b86-f5rv7\" (UID: \"2609da42-064c-4904-bfd3-3b1b90101de1\") " pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:24.019643 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:24.019618    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2609da42-064c-4904-bfd3-3b1b90101de1-webhook-cert\") pod \"maas-controller-6f5b6f4b86-f5rv7\" (UID: \"2609da42-064c-4904-bfd3-3b1b90101de1\") " pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:24.024423 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:24.024396    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76d47ddd7d-fk6s5"]
Jul 21 20:26:24.028629 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:24.028607    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sr7v\" (UniqueName: \"kubernetes.io/projected/2609da42-064c-4904-bfd3-3b1b90101de1-kube-api-access-5sr7v\") pod \"maas-controller-6f5b6f4b86-f5rv7\" (UID: \"2609da42-064c-4904-bfd3-3b1b90101de1\") " pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:24.028629 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:26:24.028619    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4540bae7_9d04_4862_b5e9_4db90b06c843.slice/crio-b437a36b3ac049c1030c217824f1718297de8fa5d544039e954b49f7d71d5d60 WatchSource:0}: Error finding container b437a36b3ac049c1030c217824f1718297de8fa5d544039e954b49f7d71d5d60: Status 404 returned error can't find the container with id b437a36b3ac049c1030c217824f1718297de8fa5d544039e954b49f7d71d5d60
Jul 21 20:26:24.099763 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:24.099677    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:24.239967 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:24.239940    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-f5rv7"]
Jul 21 20:26:24.243790 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:26:24.243767    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2609da42_064c_4904_bfd3_3b1b90101de1.slice/crio-86bf246298a369f54117e70c16fa99912d84df32f61c6c8843cac3a0a4be911c WatchSource:0}: Error finding container 86bf246298a369f54117e70c16fa99912d84df32f61c6c8843cac3a0a4be911c: Status 404 returned error can't find the container with id 86bf246298a369f54117e70c16fa99912d84df32f61c6c8843cac3a0a4be911c
Jul 21 20:26:24.982253 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:24.982206    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7" event={"ID":"2609da42-064c-4904-bfd3-3b1b90101de1","Type":"ContainerStarted","Data":"86bf246298a369f54117e70c16fa99912d84df32f61c6c8843cac3a0a4be911c"}
Jul 21 20:26:24.984210 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:24.984181    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5" event={"ID":"4540bae7-9d04-4862-b5e9-4db90b06c843","Type":"ContainerStarted","Data":"b437a36b3ac049c1030c217824f1718297de8fa5d544039e954b49f7d71d5d60"}
Jul 21 20:26:26.993848 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:26.993759    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5" event={"ID":"4540bae7-9d04-4862-b5e9-4db90b06c843","Type":"ContainerStarted","Data":"7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8"}
Jul 21 20:26:26.994267 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:26.993876    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:26.995281 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:26.995259    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7" event={"ID":"2609da42-064c-4904-bfd3-3b1b90101de1","Type":"ContainerStarted","Data":"8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7"}
Jul 21 20:26:26.995410 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:26.995388    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:27.070290 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:27.070237    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5" podStartSLOduration=1.416982312 podStartE2EDuration="4.070220109s" totalImagesPullingTime="2.653237797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:26:27.028565315 +0000 UTC m=+733.287356240" watchObservedRunningTime="2026-07-21 20:26:27.070220109 +0000 UTC m=+733.329011067"
Jul 21 20:26:27.070481 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:27.070323    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7" podStartSLOduration=1.6223809500000002 podStartE2EDuration="4.070319135s" totalImagesPullingTime="2.447938185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:26:27.068307465 +0000 UTC m=+733.327098392" watchObservedRunningTime="2026-07-21 20:26:27.070319135 +0000 UTC m=+733.329110059"
Jul 21 20:26:38.001595 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.001560    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:38.002078 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.001632    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:26:38.115605 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.115571    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76d47ddd7d-fk6s5"]
Jul 21 20:26:38.115869 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.115835    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5" podUID="4540bae7-9d04-4862-b5e9-4db90b06c843" containerName="manager" containerID="cri-o://7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8" gracePeriod=30
Jul 21 20:26:38.351967 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.351939    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:38.535655 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.535562    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4540bae7-9d04-4862-b5e9-4db90b06c843-webhook-cert\") pod \"4540bae7-9d04-4862-b5e9-4db90b06c843\" (UID: \"4540bae7-9d04-4862-b5e9-4db90b06c843\") "
Jul 21 20:26:38.535655 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.535637    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxdjn\" (UniqueName: \"kubernetes.io/projected/4540bae7-9d04-4862-b5e9-4db90b06c843-kube-api-access-cxdjn\") pod \"4540bae7-9d04-4862-b5e9-4db90b06c843\" (UID: \"4540bae7-9d04-4862-b5e9-4db90b06c843\") "
Jul 21 20:26:38.537889 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.537855    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4540bae7-9d04-4862-b5e9-4db90b06c843-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4540bae7-9d04-4862-b5e9-4db90b06c843" (UID: "4540bae7-9d04-4862-b5e9-4db90b06c843"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:26:38.538004 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.537905    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4540bae7-9d04-4862-b5e9-4db90b06c843-kube-api-access-cxdjn" (OuterVolumeSpecName: "kube-api-access-cxdjn") pod "4540bae7-9d04-4862-b5e9-4db90b06c843" (UID: "4540bae7-9d04-4862-b5e9-4db90b06c843"). InnerVolumeSpecName "kube-api-access-cxdjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:26:38.636706 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.636676    2541 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4540bae7-9d04-4862-b5e9-4db90b06c843-webhook-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:26:38.636706 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:38.636700    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxdjn\" (UniqueName: \"kubernetes.io/projected/4540bae7-9d04-4862-b5e9-4db90b06c843-kube-api-access-cxdjn\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:26:39.041194 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:39.041157    2541 generic.go:356] "Generic (PLEG): container finished" podID="4540bae7-9d04-4862-b5e9-4db90b06c843" containerID="7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8" exitCode=0
Jul 21 20:26:39.041598 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:39.041203    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5"
Jul 21 20:26:39.041598 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:39.041250    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5" event={"ID":"4540bae7-9d04-4862-b5e9-4db90b06c843","Type":"ContainerDied","Data":"7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8"}
Jul 21 20:26:39.041598 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:39.041303    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d47ddd7d-fk6s5" event={"ID":"4540bae7-9d04-4862-b5e9-4db90b06c843","Type":"ContainerDied","Data":"b437a36b3ac049c1030c217824f1718297de8fa5d544039e954b49f7d71d5d60"}
Jul 21 20:26:39.041598 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:39.041326    2541 scope.go:117] "RemoveContainer" containerID="7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8"
Jul 21 20:26:39.049951 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:39.049931    2541 scope.go:117] "RemoveContainer" containerID="7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8"
Jul 21 20:26:39.050193 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:26:39.050178    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8\": container with ID starting with 7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8 not found: ID does not exist" containerID="7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8"
Jul 21 20:26:39.050242 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:39.050200    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8"} err="failed to get container status \"7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8\": rpc error: code = NotFound desc = could not find container \"7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8\": container with ID starting with 7ad10537286da225611555adf79e7ad56f7f19d78305b9913e68a8930b3bbbd8 not found: ID does not exist"
Jul 21 20:26:39.068029 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:39.068005    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76d47ddd7d-fk6s5"]
Jul 21 20:26:39.073259 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:39.073240    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76d47ddd7d-fk6s5"]
Jul 21 20:26:40.291901 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:40.291872    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4540bae7-9d04-4862-b5e9-4db90b06c843" path="/var/lib/kubelet/pods/4540bae7-9d04-4862-b5e9-4db90b06c843/volumes"
Jul 21 20:26:57.724653 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.724621    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79888984-htpvl"]
Jul 21 20:26:57.725009 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.724899    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4540bae7-9d04-4862-b5e9-4db90b06c843" containerName="manager"
Jul 21 20:26:57.725009 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.724909    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="4540bae7-9d04-4862-b5e9-4db90b06c843" containerName="manager"
Jul 21 20:26:57.725009 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.724962    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="4540bae7-9d04-4862-b5e9-4db90b06c843" containerName="manager"
Jul 21 20:26:57.752909 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.752871    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79888984-htpvl"]
Jul 21 20:26:57.753047 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.752964    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:57.757472 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.757422    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zjkdf\""
Jul 21 20:26:57.757600 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.757565    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 20:26:57.771356 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.771328    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4j66\" (UniqueName: \"kubernetes.io/projected/9f3dbeaf-e8fc-481f-b099-62f1916fddf3-kube-api-access-w4j66\") pod \"maas-api-79888984-htpvl\" (UID: \"9f3dbeaf-e8fc-481f-b099-62f1916fddf3\") " pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:57.771498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.771372    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f3dbeaf-e8fc-481f-b099-62f1916fddf3-maas-api-tls\") pod \"maas-api-79888984-htpvl\" (UID: \"9f3dbeaf-e8fc-481f-b099-62f1916fddf3\") " pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:57.771498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.771390    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f3dbeaf-e8fc-481f-b099-62f1916fddf3-openshift-service-ca\") pod \"maas-api-79888984-htpvl\" (UID: \"9f3dbeaf-e8fc-481f-b099-62f1916fddf3\") " pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:57.872634 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.872599    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4j66\" (UniqueName: \"kubernetes.io/projected/9f3dbeaf-e8fc-481f-b099-62f1916fddf3-kube-api-access-w4j66\") pod \"maas-api-79888984-htpvl\" (UID: \"9f3dbeaf-e8fc-481f-b099-62f1916fddf3\") " pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:57.872802 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.872655    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f3dbeaf-e8fc-481f-b099-62f1916fddf3-maas-api-tls\") pod \"maas-api-79888984-htpvl\" (UID: \"9f3dbeaf-e8fc-481f-b099-62f1916fddf3\") " pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:57.872802 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.872680    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f3dbeaf-e8fc-481f-b099-62f1916fddf3-openshift-service-ca\") pod \"maas-api-79888984-htpvl\" (UID: \"9f3dbeaf-e8fc-481f-b099-62f1916fddf3\") " pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:57.873314 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.873290    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f3dbeaf-e8fc-481f-b099-62f1916fddf3-openshift-service-ca\") pod \"maas-api-79888984-htpvl\" (UID: \"9f3dbeaf-e8fc-481f-b099-62f1916fddf3\") " pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:57.875195 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.875175    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f3dbeaf-e8fc-481f-b099-62f1916fddf3-maas-api-tls\") pod \"maas-api-79888984-htpvl\" (UID: \"9f3dbeaf-e8fc-481f-b099-62f1916fddf3\") " pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:57.882861 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:57.882842    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4j66\" (UniqueName: \"kubernetes.io/projected/9f3dbeaf-e8fc-481f-b099-62f1916fddf3-kube-api-access-w4j66\") pod \"maas-api-79888984-htpvl\" (UID: \"9f3dbeaf-e8fc-481f-b099-62f1916fddf3\") " pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:58.062657 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.062624    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:26:58.199815 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.199790    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79888984-htpvl"]
Jul 21 20:26:58.202824 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:26:58.202796    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3dbeaf_e8fc_481f_b099_62f1916fddf3.slice/crio-b1a78c6aa7c75d0aef8f409c235c09748c2de26e7e7ed2d5ddc201403a8e1eea WatchSource:0}: Error finding container b1a78c6aa7c75d0aef8f409c235c09748c2de26e7e7ed2d5ddc201403a8e1eea: Status 404 returned error can't find the container with id b1a78c6aa7c75d0aef8f409c235c09748c2de26e7e7ed2d5ddc201403a8e1eea
Jul 21 20:26:58.357078 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.356996    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-k24j8"]
Jul 21 20:26:58.361305 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.361283    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:26:58.364005 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.363982    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 20:26:58.365238 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.365223    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7hztw\""
Jul 21 20:26:58.384329 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.376717    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58fpz\" (UniqueName: \"kubernetes.io/projected/7c4de662-8a28-4988-98cd-56ebc38e21e8-kube-api-access-58fpz\") pod \"payload-pre-processing-7677b774bb-k24j8\" (UID: \"7c4de662-8a28-4988-98cd-56ebc38e21e8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:26:58.384329 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.376792    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4de662-8a28-4988-98cd-56ebc38e21e8-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-k24j8\" (UID: \"7c4de662-8a28-4988-98cd-56ebc38e21e8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:26:58.384329 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.378711    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hsmcw"]
Jul 21 20:26:58.398617 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.392613    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-k24j8"]
Jul 21 20:26:58.398617 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.392737    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:26:58.404989 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.404956    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hsmcw"]
Jul 21 20:26:58.477359 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.477328    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58fpz\" (UniqueName: \"kubernetes.io/projected/7c4de662-8a28-4988-98cd-56ebc38e21e8-kube-api-access-58fpz\") pod \"payload-pre-processing-7677b774bb-k24j8\" (UID: \"7c4de662-8a28-4988-98cd-56ebc38e21e8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:26:58.477559 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.477406    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91163d56-6561-4301-9952-389f02cf4670-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hsmcw\" (UID: \"91163d56-6561-4301-9952-389f02cf4670\") " pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:26:58.477559 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.477466    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4de662-8a28-4988-98cd-56ebc38e21e8-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-k24j8\" (UID: \"7c4de662-8a28-4988-98cd-56ebc38e21e8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:26:58.477559 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.477496    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp4sr\" (UniqueName: \"kubernetes.io/projected/91163d56-6561-4301-9952-389f02cf4670-kube-api-access-jp4sr\") pod \"payload-processing-5bf47cd988-hsmcw\" (UID: \"91163d56-6561-4301-9952-389f02cf4670\") " pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:26:58.478233 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.478213    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4de662-8a28-4988-98cd-56ebc38e21e8-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-k24j8\" (UID: \"7c4de662-8a28-4988-98cd-56ebc38e21e8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:26:58.499059 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.499028    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58fpz\" (UniqueName: \"kubernetes.io/projected/7c4de662-8a28-4988-98cd-56ebc38e21e8-kube-api-access-58fpz\") pod \"payload-pre-processing-7677b774bb-k24j8\" (UID: \"7c4de662-8a28-4988-98cd-56ebc38e21e8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:26:58.578332 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.578297    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91163d56-6561-4301-9952-389f02cf4670-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hsmcw\" (UID: \"91163d56-6561-4301-9952-389f02cf4670\") " pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:26:58.578332 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.578336    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp4sr\" (UniqueName: \"kubernetes.io/projected/91163d56-6561-4301-9952-389f02cf4670-kube-api-access-jp4sr\") pod \"payload-processing-5bf47cd988-hsmcw\" (UID: \"91163d56-6561-4301-9952-389f02cf4670\") " pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:26:58.579006 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.578986    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91163d56-6561-4301-9952-389f02cf4670-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hsmcw\" (UID: \"91163d56-6561-4301-9952-389f02cf4670\") " pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:26:58.603833 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.603805    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp4sr\" (UniqueName: \"kubernetes.io/projected/91163d56-6561-4301-9952-389f02cf4670-kube-api-access-jp4sr\") pod \"payload-processing-5bf47cd988-hsmcw\" (UID: \"91163d56-6561-4301-9952-389f02cf4670\") " pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:26:58.671990 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.671907    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:26:58.712046 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.711380    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:26:58.815115 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.815092    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-k24j8"]
Jul 21 20:26:58.817784 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:26:58.817756    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4de662_8a28_4988_98cd_56ebc38e21e8.slice/crio-3a18e7261f3074d64703c0bce90779794d0f91ee1e9d67225a094310c174f026 WatchSource:0}: Error finding container 3a18e7261f3074d64703c0bce90779794d0f91ee1e9d67225a094310c174f026: Status 404 returned error can't find the container with id 3a18e7261f3074d64703c0bce90779794d0f91ee1e9d67225a094310c174f026
Jul 21 20:26:58.855676 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:58.855644    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hsmcw"]
Jul 21 20:26:58.858987 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:26:58.858952    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91163d56_6561_4301_9952_389f02cf4670.slice/crio-2e22143dfe84f8a4fbe9b431a5ec91fee02f7202bb89c32b4c64bc289bbc259e WatchSource:0}: Error finding container 2e22143dfe84f8a4fbe9b431a5ec91fee02f7202bb89c32b4c64bc289bbc259e: Status 404 returned error can't find the container with id 2e22143dfe84f8a4fbe9b431a5ec91fee02f7202bb89c32b4c64bc289bbc259e
Jul 21 20:26:59.119281 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:59.119240    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8" event={"ID":"7c4de662-8a28-4988-98cd-56ebc38e21e8","Type":"ContainerStarted","Data":"3a18e7261f3074d64703c0bce90779794d0f91ee1e9d67225a094310c174f026"}
Jul 21 20:26:59.120392 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:59.120368    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79888984-htpvl" event={"ID":"9f3dbeaf-e8fc-481f-b099-62f1916fddf3","Type":"ContainerStarted","Data":"b1a78c6aa7c75d0aef8f409c235c09748c2de26e7e7ed2d5ddc201403a8e1eea"}
Jul 21 20:26:59.121346 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:26:59.121326    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw" event={"ID":"91163d56-6561-4301-9952-389f02cf4670","Type":"ContainerStarted","Data":"2e22143dfe84f8a4fbe9b431a5ec91fee02f7202bb89c32b4c64bc289bbc259e"}
Jul 21 20:27:01.137177 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:01.137139    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw" event={"ID":"91163d56-6561-4301-9952-389f02cf4670","Type":"ContainerStarted","Data":"abca73a81c9f7d790a0caec9a314dc151428cff4d4391ae6b0cd3fae4d65c440"}
Jul 21 20:27:01.137644 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:01.137209    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:27:01.138509 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:01.138486    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8" event={"ID":"7c4de662-8a28-4988-98cd-56ebc38e21e8","Type":"ContainerStarted","Data":"9bf91836b4e22ff6925c396dfc07da6eb5648f84b23d29f1ef18b78a0be1e3e8"}
Jul 21 20:27:01.138631 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:01.138539    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:27:01.139839 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:01.139818    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79888984-htpvl" event={"ID":"9f3dbeaf-e8fc-481f-b099-62f1916fddf3","Type":"ContainerStarted","Data":"09e9faf696084a9039c916da2495721cb22fc61b9a3acfb150f3afa30a4c3c05"}
Jul 21 20:27:01.139945 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:01.139935    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:27:01.159937 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:01.159893    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw" podStartSLOduration=1.275887024 podStartE2EDuration="3.159879109s" totalImagesPullingTime="1.883992085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:27:01.158724806 +0000 UTC m=+767.417515725" watchObservedRunningTime="2026-07-21 20:27:01.159879109 +0000 UTC m=+767.418670013"
Jul 21 20:27:01.178758 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:01.178695    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79888984-htpvl" podStartSLOduration=2.18974493 podStartE2EDuration="4.178676261s" totalImagesPullingTime="1.988931331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:27:01.177451454 +0000 UTC m=+767.436242380" watchObservedRunningTime="2026-07-21 20:27:01.178676261 +0000 UTC m=+767.437467193"
Jul 21 20:27:01.194857 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:01.194789    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8" podStartSLOduration=1.264666682 podStartE2EDuration="3.194771766s" totalImagesPullingTime="1.930105084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:27:01.194054533 +0000 UTC m=+767.452845457" watchObservedRunningTime="2026-07-21 20:27:01.194771766 +0000 UTC m=+767.453562699"
Jul 21 20:27:07.149532 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:07.149501    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79888984-htpvl"
Jul 21 20:27:12.146087 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.146052    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-hsmcw"
Jul 21 20:27:12.146692 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.146364    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-k24j8"
Jul 21 20:27:12.407023 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.406942    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"]
Jul 21 20:27:12.409959 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.409940    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.412749 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.412726    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 20:27:12.413202 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.413183    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 20:27:12.413306 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.413222    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 20:27:12.413708 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.413695    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sn7s4\""
Jul 21 20:27:12.428166 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.428145    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"]
Jul 21 20:27:12.490975 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.490934    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dvq5\" (UniqueName: \"kubernetes.io/projected/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-kube-api-access-7dvq5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.490975 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.490980    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.491162 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.491004    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.491162 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.491057    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.491162 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.491120    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.491162 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.491146    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.592156 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.592122    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dvq5\" (UniqueName: \"kubernetes.io/projected/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-kube-api-access-7dvq5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.592156 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.592159    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.592371 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.592190    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.592371 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.592219    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.592371 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.592261    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.592371 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.592293    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.592698 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.592676    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.592754 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.592701    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.592790 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.592759    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.594635 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.594613    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.594869 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.594853    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.606584 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.606561    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dvq5\" (UniqueName: \"kubernetes.io/projected/f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec-kube-api-access-7dvq5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d\" (UID: \"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.721082 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.721007    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:12.854118 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:12.854092    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"]
Jul 21 20:27:12.856630 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:27:12.856599    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5517bfd_1dce_4bcb_a9b9_eddf4bce5fec.slice/crio-7d5e1726fd4604f138c9c5054e68419cd2c30b504ae3666d82df6782c7627617 WatchSource:0}: Error finding container 7d5e1726fd4604f138c9c5054e68419cd2c30b504ae3666d82df6782c7627617: Status 404 returned error can't find the container with id 7d5e1726fd4604f138c9c5054e68419cd2c30b504ae3666d82df6782c7627617
Jul 21 20:27:13.191028 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:13.190948    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d" event={"ID":"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec","Type":"ContainerStarted","Data":"7d5e1726fd4604f138c9c5054e68419cd2c30b504ae3666d82df6782c7627617"}
Jul 21 20:27:14.196291 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:14.196259    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d" event={"ID":"f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec","Type":"ContainerStarted","Data":"3b04b456df58c330484e4b6f1bd34def2298a3a438fc17663b799803fab165be"}
Jul 21 20:27:14.221986 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:14.221932    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d" podStartSLOduration=1.047780852 podStartE2EDuration="2.221913169s" totalImagesPullingTime="1.174132317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:27:14.220556851 +0000 UTC m=+780.479347778" watchObservedRunningTime="2026-07-21 20:27:14.221913169 +0000 UTC m=+780.480704096"
Jul 21 20:27:22.721850 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:22.721817    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:22.722264 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:22.721872    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:22.734272 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:22.734246    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:27:23.246542 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:27:23.246511    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d"
Jul 21 20:28:26.390508 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.390468    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"]
Jul 21 20:28:26.393639 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.393623    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.396268 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.396238    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 20:28:26.406458 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.406416    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"]
Jul 21 20:28:26.491566 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.491528    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.491729 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.491577    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.491729 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.491596    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t94p8\" (UniqueName: \"kubernetes.io/projected/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-kube-api-access-t94p8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.491729 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.491624    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.491729 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.491689    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.491729 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.491722    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.592383 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.592349    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.592592 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.592401    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.592592 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.592423    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.592592 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.592489    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t94p8\" (UniqueName: \"kubernetes.io/projected/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-kube-api-access-t94p8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.592592 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.592515    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.592816 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.592665    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.592900 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.592869    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.592951 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.592934    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.592998 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.592971    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.594824 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.594803    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.595118 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.595099    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.601861 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.601835    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t94p8\" (UniqueName: \"kubernetes.io/projected/78a23cf8-bb3b-4aac-8ad2-41a41703fbc9-kube-api-access-t94p8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc\" (UID: \"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.703283 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.703202    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:26.835606 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:26.835581    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"]
Jul 21 20:28:26.838172 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:28:26.838134    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78a23cf8_bb3b_4aac_8ad2_41a41703fbc9.slice/crio-fbc22b1e2c4f61a8ea36c3a7d4935181767a82b0cea853abf9150b4924462bb4 WatchSource:0}: Error finding container fbc22b1e2c4f61a8ea36c3a7d4935181767a82b0cea853abf9150b4924462bb4: Status 404 returned error can't find the container with id fbc22b1e2c4f61a8ea36c3a7d4935181767a82b0cea853abf9150b4924462bb4
Jul 21 20:28:27.490491 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:27.490392    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc" event={"ID":"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9","Type":"ContainerStarted","Data":"d6f60c01781ddd2faea4a61596ca4ff8f3b3521dff383ac10b8f6e7ac3810eb6"}
Jul 21 20:28:27.490491 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:27.490452    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc" event={"ID":"78a23cf8-bb3b-4aac-8ad2-41a41703fbc9","Type":"ContainerStarted","Data":"fbc22b1e2c4f61a8ea36c3a7d4935181767a82b0cea853abf9150b4924462bb4"}
Jul 21 20:28:27.513011 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:27.512961    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc" podStartSLOduration=1.322299331 podStartE2EDuration="1.51294686s" totalImagesPullingTime="190.647529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:28:27.511722967 +0000 UTC m=+853.770513891" watchObservedRunningTime="2026-07-21 20:28:27.51294686 +0000 UTC m=+853.771737784"
Jul 21 20:28:36.703455 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:36.703408    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:36.703897 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:36.703694    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:36.715841 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:36.715823    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:28:37.542799 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:28:37.542766    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc"
Jul 21 20:30:18.112190 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.112152    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-f5rv7"]
Jul 21 20:30:18.112692 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.112412    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7" podUID="2609da42-064c-4904-bfd3-3b1b90101de1" containerName="manager" containerID="cri-o://8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7" gracePeriod=30
Jul 21 20:30:18.354527 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.354493    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:30:18.445939 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.445861    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2609da42-064c-4904-bfd3-3b1b90101de1-webhook-cert\") pod \"2609da42-064c-4904-bfd3-3b1b90101de1\" (UID: \"2609da42-064c-4904-bfd3-3b1b90101de1\") "
Jul 21 20:30:18.445939 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.445906    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sr7v\" (UniqueName: \"kubernetes.io/projected/2609da42-064c-4904-bfd3-3b1b90101de1-kube-api-access-5sr7v\") pod \"2609da42-064c-4904-bfd3-3b1b90101de1\" (UID: \"2609da42-064c-4904-bfd3-3b1b90101de1\") "
Jul 21 20:30:18.448022 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.447990    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2609da42-064c-4904-bfd3-3b1b90101de1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2609da42-064c-4904-bfd3-3b1b90101de1" (UID: "2609da42-064c-4904-bfd3-3b1b90101de1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:30:18.448126 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.448044    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2609da42-064c-4904-bfd3-3b1b90101de1-kube-api-access-5sr7v" (OuterVolumeSpecName: "kube-api-access-5sr7v") pod "2609da42-064c-4904-bfd3-3b1b90101de1" (UID: "2609da42-064c-4904-bfd3-3b1b90101de1"). InnerVolumeSpecName "kube-api-access-5sr7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:30:18.546724 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.546694    2541 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2609da42-064c-4904-bfd3-3b1b90101de1-webhook-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:30:18.546724 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.546719    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sr7v\" (UniqueName: \"kubernetes.io/projected/2609da42-064c-4904-bfd3-3b1b90101de1-kube-api-access-5sr7v\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:30:18.955137 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.955105    2541 generic.go:356] "Generic (PLEG): container finished" podID="2609da42-064c-4904-bfd3-3b1b90101de1" containerID="8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7" exitCode=0
Jul 21 20:30:18.955297 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.955151    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7"
Jul 21 20:30:18.955297 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.955189    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7" event={"ID":"2609da42-064c-4904-bfd3-3b1b90101de1","Type":"ContainerDied","Data":"8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7"}
Jul 21 20:30:18.955297 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.955241    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-f5rv7" event={"ID":"2609da42-064c-4904-bfd3-3b1b90101de1","Type":"ContainerDied","Data":"86bf246298a369f54117e70c16fa99912d84df32f61c6c8843cac3a0a4be911c"}
Jul 21 20:30:18.955297 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.955263    2541 scope.go:117] "RemoveContainer" containerID="8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7"
Jul 21 20:30:18.963713 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.963697    2541 scope.go:117] "RemoveContainer" containerID="8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7"
Jul 21 20:30:18.963981 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:30:18.963962    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7\": container with ID starting with 8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7 not found: ID does not exist" containerID="8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7"
Jul 21 20:30:18.964028 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.963989    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7"} err="failed to get container status \"8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7\": rpc error: code = NotFound desc = could not find container \"8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7\": container with ID starting with 8834097785ac374df314178170459a9ede680f935e3041ffea162dfd2ed875a7 not found: ID does not exist"
Jul 21 20:30:18.976491 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.976469    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-f5rv7"]
Jul 21 20:30:18.982911 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:18.982891    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-f5rv7"]
Jul 21 20:30:20.292713 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:30:20.292680    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2609da42-064c-4904-bfd3-3b1b90101de1" path="/var/lib/kubelet/pods/2609da42-064c-4904-bfd3-3b1b90101de1/volumes"
Jul 21 20:31:19.832329 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.832292    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-v5qsx"]
Jul 21 20:31:19.832792 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.832613    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2609da42-064c-4904-bfd3-3b1b90101de1" containerName="manager"
Jul 21 20:31:19.832792 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.832625    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="2609da42-064c-4904-bfd3-3b1b90101de1" containerName="manager"
Jul 21 20:31:19.832792 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.832694    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="2609da42-064c-4904-bfd3-3b1b90101de1" containerName="manager"
Jul 21 20:31:19.836473 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.836457    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:19.839086 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.839066    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 20:31:19.840015 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.839994    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 20:31:19.840120 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.840001    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zk2ck\""
Jul 21 20:31:19.849425 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.849399    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-v5qsx"]
Jul 21 20:31:19.949628 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.949585    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkn9x\" (UniqueName: \"kubernetes.io/projected/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-kube-api-access-fkn9x\") pod \"maas-controller-6f5b6f4b86-v5qsx\" (UID: \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\") " pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:19.949850 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:19.949721    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-webhook-cert\") pod \"maas-controller-6f5b6f4b86-v5qsx\" (UID: \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\") " pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:20.050166 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:20.050113    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-webhook-cert\") pod \"maas-controller-6f5b6f4b86-v5qsx\" (UID: \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\") " pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:20.050166 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:20.050169    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkn9x\" (UniqueName: \"kubernetes.io/projected/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-kube-api-access-fkn9x\") pod \"maas-controller-6f5b6f4b86-v5qsx\" (UID: \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\") " pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:20.052728 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:20.052696    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-webhook-cert\") pod \"maas-controller-6f5b6f4b86-v5qsx\" (UID: \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\") " pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:20.060343 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:20.060318    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkn9x\" (UniqueName: \"kubernetes.io/projected/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-kube-api-access-fkn9x\") pod \"maas-controller-6f5b6f4b86-v5qsx\" (UID: \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\") " pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:20.146686 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:20.146599    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:20.282038 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:20.282017    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-v5qsx"]
Jul 21 20:31:20.284092 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:31:20.284063    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc51911d_7b18_4cf5_8546_e09c0d6ac3d8.slice/crio-ad0770f848cd3fbd0d8b1be8577ede6c269ebb8a7ad97d822d536ec97cacd3a2 WatchSource:0}: Error finding container ad0770f848cd3fbd0d8b1be8577ede6c269ebb8a7ad97d822d536ec97cacd3a2: Status 404 returned error can't find the container with id ad0770f848cd3fbd0d8b1be8577ede6c269ebb8a7ad97d822d536ec97cacd3a2
Jul 21 20:31:20.285382 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:20.285365    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:31:21.206232 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:21.206190    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx" event={"ID":"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8","Type":"ContainerStarted","Data":"2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692"}
Jul 21 20:31:21.206649 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:21.206245    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx" event={"ID":"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8","Type":"ContainerStarted","Data":"ad0770f848cd3fbd0d8b1be8577ede6c269ebb8a7ad97d822d536ec97cacd3a2"}
Jul 21 20:31:21.206649 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:21.206313    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:21.226474 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:21.226402    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx" podStartSLOduration=1.866036093 podStartE2EDuration="2.226384384s" totalImagesPullingTime="360.348291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:31:21.225092658 +0000 UTC m=+1027.483883606" watchObservedRunningTime="2026-07-21 20:31:21.226384384 +0000 UTC m=+1027.485175308"
Jul 21 20:31:32.212781 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:32.212752    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:36.849384 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:36.849347    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-v5qsx"]
Jul 21 20:31:36.849803 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:36.849562    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx" podUID="cc51911d-7b18-4cf5-8546-e09c0d6ac3d8" containerName="manager" containerID="cri-o://2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692" gracePeriod=30
Jul 21 20:31:37.091282 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.091257    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:37.200927 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.200844    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkn9x\" (UniqueName: \"kubernetes.io/projected/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-kube-api-access-fkn9x\") pod \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\" (UID: \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\") "
Jul 21 20:31:37.200927 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.200898    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-webhook-cert\") pod \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\" (UID: \"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8\") "
Jul 21 20:31:37.203004 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.202976    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cc51911d-7b18-4cf5-8546-e09c0d6ac3d8" (UID: "cc51911d-7b18-4cf5-8546-e09c0d6ac3d8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:31:37.203098 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.202976    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-kube-api-access-fkn9x" (OuterVolumeSpecName: "kube-api-access-fkn9x") pod "cc51911d-7b18-4cf5-8546-e09c0d6ac3d8" (UID: "cc51911d-7b18-4cf5-8546-e09c0d6ac3d8"). InnerVolumeSpecName "kube-api-access-fkn9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:31:37.276841 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.276802    2541 generic.go:356] "Generic (PLEG): container finished" podID="cc51911d-7b18-4cf5-8546-e09c0d6ac3d8" containerID="2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692" exitCode=0
Jul 21 20:31:37.276981 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.276857    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx"
Jul 21 20:31:37.276981 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.276877    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx" event={"ID":"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8","Type":"ContainerDied","Data":"2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692"}
Jul 21 20:31:37.276981 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.276954    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-v5qsx" event={"ID":"cc51911d-7b18-4cf5-8546-e09c0d6ac3d8","Type":"ContainerDied","Data":"ad0770f848cd3fbd0d8b1be8577ede6c269ebb8a7ad97d822d536ec97cacd3a2"}
Jul 21 20:31:37.276981 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.276977    2541 scope.go:117] "RemoveContainer" containerID="2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692"
Jul 21 20:31:37.286076 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.286048    2541 scope.go:117] "RemoveContainer" containerID="2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692"
Jul 21 20:31:37.286336 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:31:37.286318    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692\": container with ID starting with 2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692 not found: ID does not exist" containerID="2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692"
Jul 21 20:31:37.286392 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.286344    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692"} err="failed to get container status \"2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692\": rpc error: code = NotFound desc = could not find container \"2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692\": container with ID starting with 2f2a00d92b83f84c68519be01a32efaf10bcb897a122a4ee525e559df6632692 not found: ID does not exist"
Jul 21 20:31:37.299746 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.299718    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-v5qsx"]
Jul 21 20:31:37.301387 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.301375    2541 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-webhook-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:31:37.301452 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.301391    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkn9x\" (UniqueName: \"kubernetes.io/projected/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8-kube-api-access-fkn9x\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:31:37.306250 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:37.306229    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-v5qsx"]
Jul 21 20:31:38.103749 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.103720    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-knrz5"]
Jul 21 20:31:38.104119 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.104026    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc51911d-7b18-4cf5-8546-e09c0d6ac3d8" containerName="manager"
Jul 21 20:31:38.104119 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.104037    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc51911d-7b18-4cf5-8546-e09c0d6ac3d8" containerName="manager"
Jul 21 20:31:38.104119 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.104089    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc51911d-7b18-4cf5-8546-e09c0d6ac3d8" containerName="manager"
Jul 21 20:31:38.108104 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.108080    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:31:38.112926 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.112901    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 20:31:38.112926 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.112915    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 20:31:38.113113 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.112913    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zk2ck\""
Jul 21 20:31:38.127468 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.127421    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-knrz5"]
Jul 21 20:31:38.209249 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.209212    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx8sz\" (UniqueName: \"kubernetes.io/projected/816f4822-6e32-440b-8c4a-f9a1e0d3526b-kube-api-access-rx8sz\") pod \"maas-controller-6f5b6f4b86-knrz5\" (UID: \"816f4822-6e32-440b-8c4a-f9a1e0d3526b\") " pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:31:38.209455 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.209289    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/816f4822-6e32-440b-8c4a-f9a1e0d3526b-webhook-cert\") pod \"maas-controller-6f5b6f4b86-knrz5\" (UID: \"816f4822-6e32-440b-8c4a-f9a1e0d3526b\") " pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:31:38.292762 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.292733    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc51911d-7b18-4cf5-8546-e09c0d6ac3d8" path="/var/lib/kubelet/pods/cc51911d-7b18-4cf5-8546-e09c0d6ac3d8/volumes"
Jul 21 20:31:38.310050 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.310022    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx8sz\" (UniqueName: \"kubernetes.io/projected/816f4822-6e32-440b-8c4a-f9a1e0d3526b-kube-api-access-rx8sz\") pod \"maas-controller-6f5b6f4b86-knrz5\" (UID: \"816f4822-6e32-440b-8c4a-f9a1e0d3526b\") " pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:31:38.310143 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.310089    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/816f4822-6e32-440b-8c4a-f9a1e0d3526b-webhook-cert\") pod \"maas-controller-6f5b6f4b86-knrz5\" (UID: \"816f4822-6e32-440b-8c4a-f9a1e0d3526b\") " pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:31:38.312763 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.312731    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/816f4822-6e32-440b-8c4a-f9a1e0d3526b-webhook-cert\") pod \"maas-controller-6f5b6f4b86-knrz5\" (UID: \"816f4822-6e32-440b-8c4a-f9a1e0d3526b\") " pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:31:38.320890 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.320861    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx8sz\" (UniqueName: \"kubernetes.io/projected/816f4822-6e32-440b-8c4a-f9a1e0d3526b-kube-api-access-rx8sz\") pod \"maas-controller-6f5b6f4b86-knrz5\" (UID: \"816f4822-6e32-440b-8c4a-f9a1e0d3526b\") " pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:31:38.417822 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.417728    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:31:38.560785 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:38.560754    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5b6f4b86-knrz5"]
Jul 21 20:31:38.564337 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:31:38.564311    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816f4822_6e32_440b_8c4a_f9a1e0d3526b.slice/crio-69a93b37a9ae2a096221c1d54447ef3ed530ab420d630ab41fadc900441013a3 WatchSource:0}: Error finding container 69a93b37a9ae2a096221c1d54447ef3ed530ab420d630ab41fadc900441013a3: Status 404 returned error can't find the container with id 69a93b37a9ae2a096221c1d54447ef3ed530ab420d630ab41fadc900441013a3
Jul 21 20:31:39.288515 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:39.288477    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-knrz5" event={"ID":"816f4822-6e32-440b-8c4a-f9a1e0d3526b","Type":"ContainerStarted","Data":"b609aa60a0aaa626a39ea4c7c5a65e5d2f01b9527f3f48fac5886dedd7125515"}
Jul 21 20:31:39.288916 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:39.288537    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5b6f4b86-knrz5" event={"ID":"816f4822-6e32-440b-8c4a-f9a1e0d3526b","Type":"ContainerStarted","Data":"69a93b37a9ae2a096221c1d54447ef3ed530ab420d630ab41fadc900441013a3"}
Jul 21 20:31:39.288916 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:39.288674    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:31:39.333020 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:39.332963    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f5b6f4b86-knrz5" podStartSLOduration=0.915228207 podStartE2EDuration="1.332945042s" totalImagesPullingTime="417.716835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:31:39.331926295 +0000 UTC m=+1045.590717221" watchObservedRunningTime="2026-07-21 20:31:39.332945042 +0000 UTC m=+1045.591735965"
Jul 21 20:31:50.295184 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:31:50.295159    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f5b6f4b86-knrz5"
Jul 21 20:40:49.921129 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:49.921097    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"]
Jul 21 20:40:49.924092 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:49.924076    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:49.927567 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:49.927546    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-da01abe3-kserve-self-signed-certs\""
Jul 21 20:40:49.949947 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:49.949918    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"]
Jul 21 20:40:50.010946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.010911    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-tmp-dir\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.010946 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.010943    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edfced62-438b-4daa-9be4-569e4158499f-tls-certs\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.011134 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.010964    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-model-cache\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.011134 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.010986    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gzj6\" (UniqueName: \"kubernetes.io/projected/edfced62-438b-4daa-9be4-569e4158499f-kube-api-access-5gzj6\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.011134 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.011075    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-home\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.011134 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.011103    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-dshm\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.112567 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.112526    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-tmp-dir\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.112567 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.112564    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edfced62-438b-4daa-9be4-569e4158499f-tls-certs\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.112861 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.112593    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-model-cache\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.112861 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.112722    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gzj6\" (UniqueName: \"kubernetes.io/projected/edfced62-438b-4daa-9be4-569e4158499f-kube-api-access-5gzj6\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.112861 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.112792    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-home\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.112861 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.112823    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-dshm\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.113194 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.112932    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-tmp-dir\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.113194 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.112979    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-model-cache\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.113194 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.113083    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-home\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.115056 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.115033    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-dshm\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.115205 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.115186    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edfced62-438b-4daa-9be4-569e4158499f-tls-certs\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.122774 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.122745    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gzj6\" (UniqueName: \"kubernetes.io/projected/edfced62-438b-4daa-9be4-569e4158499f-kube-api-access-5gzj6\") pod \"e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") " pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.232287 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.232194    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:40:50.365619 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.365594    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"]
Jul 21 20:40:50.367856 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:40:50.367832    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedfced62_438b_4daa_9be4_569e4158499f.slice/crio-5266e4c02640ef59f547ab5f1b118012d1318ca52a20fd77519082c745d4e211 WatchSource:0}: Error finding container 5266e4c02640ef59f547ab5f1b118012d1318ca52a20fd77519082c745d4e211: Status 404 returned error can't find the container with id 5266e4c02640ef59f547ab5f1b118012d1318ca52a20fd77519082c745d4e211
Jul 21 20:40:50.571543 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.571506    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv" event={"ID":"edfced62-438b-4daa-9be4-569e4158499f","Type":"ContainerStarted","Data":"35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3"}
Jul 21 20:40:50.571717 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.571552    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv" event={"ID":"edfced62-438b-4daa-9be4-569e4158499f","Type":"ContainerStarted","Data":"5266e4c02640ef59f547ab5f1b118012d1318ca52a20fd77519082c745d4e211"}
Jul 21 20:40:50.591036 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:40:50.590989    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv" podStartSLOduration=1.59097628 podStartE2EDuration="1.59097628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:50.590216412 +0000 UTC m=+1596.849007336" watchObservedRunningTime="2026-07-21 20:40:50.59097628 +0000 UTC m=+1596.849767203"
Jul 21 20:41:00.232548 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:00.232495    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:41:00.232548 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:00.232563    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:41:00.244807 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:00.244779    2541 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:41:00.622326 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:00.622301    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:41:13.679726 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:13.679641    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"]
Jul 21 20:41:28.700277 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:28.700218    2541 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv" podUID="edfced62-438b-4daa-9be4-569e4158499f" containerName="main" containerID="cri-o://35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3" gracePeriod=45
Jul 21 20:41:28.951913 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:28.951852    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:41:29.044442 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044410    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-home\") pod \"edfced62-438b-4daa-9be4-569e4158499f\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") "
Jul 21 20:41:29.044606 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044481    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edfced62-438b-4daa-9be4-569e4158499f-tls-certs\") pod \"edfced62-438b-4daa-9be4-569e4158499f\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") "
Jul 21 20:41:29.044606 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044508    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-tmp-dir\") pod \"edfced62-438b-4daa-9be4-569e4158499f\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") "
Jul 21 20:41:29.044606 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044554    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-dshm\") pod \"edfced62-438b-4daa-9be4-569e4158499f\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") "
Jul 21 20:41:29.044732 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044604    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gzj6\" (UniqueName: \"kubernetes.io/projected/edfced62-438b-4daa-9be4-569e4158499f-kube-api-access-5gzj6\") pod \"edfced62-438b-4daa-9be4-569e4158499f\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") "
Jul 21 20:41:29.044732 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044650    2541 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-model-cache\") pod \"edfced62-438b-4daa-9be4-569e4158499f\" (UID: \"edfced62-438b-4daa-9be4-569e4158499f\") "
Jul 21 20:41:29.044732 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044708    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-home" (OuterVolumeSpecName: "home") pod "edfced62-438b-4daa-9be4-569e4158499f" (UID: "edfced62-438b-4daa-9be4-569e4158499f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:41:29.044876 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044792    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "edfced62-438b-4daa-9be4-569e4158499f" (UID: "edfced62-438b-4daa-9be4-569e4158499f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:41:29.044986 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044957    2541 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:41:29.045099 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044998    2541 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:41:29.045099 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.044956    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-model-cache" (OuterVolumeSpecName: "model-cache") pod "edfced62-438b-4daa-9be4-569e4158499f" (UID: "edfced62-438b-4daa-9be4-569e4158499f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:41:29.046835 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.046815    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-dshm" (OuterVolumeSpecName: "dshm") pod "edfced62-438b-4daa-9be4-569e4158499f" (UID: "edfced62-438b-4daa-9be4-569e4158499f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:41:29.046917 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.046866    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edfced62-438b-4daa-9be4-569e4158499f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "edfced62-438b-4daa-9be4-569e4158499f" (UID: "edfced62-438b-4daa-9be4-569e4158499f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:41:29.046964 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.046934    2541 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edfced62-438b-4daa-9be4-569e4158499f-kube-api-access-5gzj6" (OuterVolumeSpecName: "kube-api-access-5gzj6") pod "edfced62-438b-4daa-9be4-569e4158499f" (UID: "edfced62-438b-4daa-9be4-569e4158499f"). InnerVolumeSpecName "kube-api-access-5gzj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:41:29.145326 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.145288    2541 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gzj6\" (UniqueName: \"kubernetes.io/projected/edfced62-438b-4daa-9be4-569e4158499f-kube-api-access-5gzj6\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:41:29.145326 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.145318    2541 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:41:29.145326 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.145329    2541 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edfced62-438b-4daa-9be4-569e4158499f-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:41:29.145326 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.145336    2541 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edfced62-438b-4daa-9be4-569e4158499f-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 21 20:41:29.730167 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.730127    2541 generic.go:356] "Generic (PLEG): container finished" podID="edfced62-438b-4daa-9be4-569e4158499f" containerID="35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3" exitCode=0
Jul 21 20:41:29.730167 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.730168    2541 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"
Jul 21 20:41:29.730644 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.730201    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv" event={"ID":"edfced62-438b-4daa-9be4-569e4158499f","Type":"ContainerDied","Data":"35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3"}
Jul 21 20:41:29.730644 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.730232    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv" event={"ID":"edfced62-438b-4daa-9be4-569e4158499f","Type":"ContainerDied","Data":"5266e4c02640ef59f547ab5f1b118012d1318ca52a20fd77519082c745d4e211"}
Jul 21 20:41:29.730644 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.730249    2541 scope.go:117] "RemoveContainer" containerID="35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3"
Jul 21 20:41:29.739351 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.739332    2541 scope.go:117] "RemoveContainer" containerID="35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3"
Jul 21 20:41:29.739671 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:41:29.739652    2541 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3\": container with ID starting with 35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3 not found: ID does not exist" containerID="35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3"
Jul 21 20:41:29.739748 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.739683    2541 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3"} err="failed to get container status \"35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3\": rpc error: code = NotFound desc = could not find container \"35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3\": container with ID starting with 35d820c8947b3d4b220a179604db0153626fe446ad4df34a8a8e5f2e042227d3 not found: ID does not exist"
Jul 21 20:41:29.767754 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.767719    2541 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"]
Jul 21 20:41:29.769171 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:29.769152    2541 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-da01abe3-kserve-5649647c95-gklhv"]
Jul 21 20:41:30.292503 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:41:30.292474    2541 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edfced62-438b-4daa-9be4-569e4158499f" path="/var/lib/kubelet/pods/edfced62-438b-4daa-9be4-569e4158499f/volumes"
Jul 21 20:45:06.000346 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.000308    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"]
Jul 21 20:45:06.000951 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.000663    2541 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edfced62-438b-4daa-9be4-569e4158499f" containerName="main"
Jul 21 20:45:06.000951 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.000676    2541 state_mem.go:107] "Deleted CPUSet assignment" podUID="edfced62-438b-4daa-9be4-569e4158499f" containerName="main"
Jul 21 20:45:06.000951 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.000748    2541 memory_manager.go:368] "RemoveStaleState removing state" podUID="edfced62-438b-4daa-9be4-569e4158499f" containerName="main"
Jul 21 20:45:06.003482 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.003463    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.010701 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.010685    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7bc6ce31-serving-cert\""
Jul 21 20:45:06.028643 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.028615    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"]
Jul 21 20:45:06.162168 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.162125    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6204be34-847f-4f7d-a05e-e6afd34aa294-openshift-service-ca\") pod \"maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm\" (UID: \"6204be34-847f-4f7d-a05e-e6afd34aa294\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.162354 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.162236    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6204be34-847f-4f7d-a05e-e6afd34aa294-maas-api-tls\") pod \"maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm\" (UID: \"6204be34-847f-4f7d-a05e-e6afd34aa294\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.162354 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.162260    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhznv\" (UniqueName: \"kubernetes.io/projected/6204be34-847f-4f7d-a05e-e6afd34aa294-kube-api-access-mhznv\") pod \"maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm\" (UID: \"6204be34-847f-4f7d-a05e-e6afd34aa294\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.263119 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.263089    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6204be34-847f-4f7d-a05e-e6afd34aa294-maas-api-tls\") pod \"maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm\" (UID: \"6204be34-847f-4f7d-a05e-e6afd34aa294\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.263277 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.263133    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhznv\" (UniqueName: \"kubernetes.io/projected/6204be34-847f-4f7d-a05e-e6afd34aa294-kube-api-access-mhznv\") pod \"maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm\" (UID: \"6204be34-847f-4f7d-a05e-e6afd34aa294\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.263277 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.263187    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6204be34-847f-4f7d-a05e-e6afd34aa294-openshift-service-ca\") pod \"maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm\" (UID: \"6204be34-847f-4f7d-a05e-e6afd34aa294\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.263943 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.263925    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6204be34-847f-4f7d-a05e-e6afd34aa294-openshift-service-ca\") pod \"maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm\" (UID: \"6204be34-847f-4f7d-a05e-e6afd34aa294\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.265741 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.265719    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6204be34-847f-4f7d-a05e-e6afd34aa294-maas-api-tls\") pod \"maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm\" (UID: \"6204be34-847f-4f7d-a05e-e6afd34aa294\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.280652 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.280627    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhznv\" (UniqueName: \"kubernetes.io/projected/6204be34-847f-4f7d-a05e-e6afd34aa294-kube-api-access-mhznv\") pod \"maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm\" (UID: \"6204be34-847f-4f7d-a05e-e6afd34aa294\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.314028 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.313994    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:06.461246 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.461221    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"]
Jul 21 20:45:06.464099 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:45:06.464071    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6204be34_847f_4f7d_a05e_e6afd34aa294.slice/crio-3071ae407106f91eed9c2d23e269e2373254b28c0ddd4d4c872432e88d30df8a WatchSource:0}: Error finding container 3071ae407106f91eed9c2d23e269e2373254b28c0ddd4d4c872432e88d30df8a: Status 404 returned error can't find the container with id 3071ae407106f91eed9c2d23e269e2373254b28c0ddd4d4c872432e88d30df8a
Jul 21 20:45:06.465828 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.465801    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:45:06.616783 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:06.616703    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm" event={"ID":"6204be34-847f-4f7d-a05e-e6afd34aa294","Type":"ContainerStarted","Data":"3071ae407106f91eed9c2d23e269e2373254b28c0ddd4d4c872432e88d30df8a"}
Jul 21 20:45:07.621974 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:07.621941    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm" event={"ID":"6204be34-847f-4f7d-a05e-e6afd34aa294","Type":"ContainerStarted","Data":"9b97e8e8e2d8c7bd379a8670f66a87ffaac0b83cd3f95e640c32adb48b3b3cb5"}
Jul 21 20:45:07.622337 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:07.622084    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:13.631539 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:13.631507    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm"
Jul 21 20:45:13.675861 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:13.675797    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm" podStartSLOduration=7.900156694 podStartE2EDuration="8.675780576s" totalImagesPullingTime="775.623882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:45:07.65888864 +0000 UTC m=+1853.917679582" watchObservedRunningTime="2026-07-21 20:45:13.675780576 +0000 UTC m=+1859.934571499"
Jul 21 20:45:35.299059 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.298961    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"]
Jul 21 20:45:35.302189 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.302174    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.305528 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.305506    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-868c4ca9-serving-cert\""
Jul 21 20:45:35.319374 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.319342    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"]
Jul 21 20:45:35.399765 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.399698    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f95d02a-e40f-4e6c-b0ee-835934c8d291-openshift-service-ca\") pod \"maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq\" (UID: \"7f95d02a-e40f-4e6c-b0ee-835934c8d291\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.399765 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.399733    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84dkj\" (UniqueName: \"kubernetes.io/projected/7f95d02a-e40f-4e6c-b0ee-835934c8d291-kube-api-access-84dkj\") pod \"maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq\" (UID: \"7f95d02a-e40f-4e6c-b0ee-835934c8d291\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.400072 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.399801    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f95d02a-e40f-4e6c-b0ee-835934c8d291-maas-api-tls\") pod \"maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq\" (UID: \"7f95d02a-e40f-4e6c-b0ee-835934c8d291\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.500390 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.500352    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f95d02a-e40f-4e6c-b0ee-835934c8d291-maas-api-tls\") pod \"maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq\" (UID: \"7f95d02a-e40f-4e6c-b0ee-835934c8d291\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.500576 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.500466    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f95d02a-e40f-4e6c-b0ee-835934c8d291-openshift-service-ca\") pod \"maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq\" (UID: \"7f95d02a-e40f-4e6c-b0ee-835934c8d291\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.500576 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.500499    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84dkj\" (UniqueName: \"kubernetes.io/projected/7f95d02a-e40f-4e6c-b0ee-835934c8d291-kube-api-access-84dkj\") pod \"maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq\" (UID: \"7f95d02a-e40f-4e6c-b0ee-835934c8d291\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.501243 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.501219    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f95d02a-e40f-4e6c-b0ee-835934c8d291-openshift-service-ca\") pod \"maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq\" (UID: \"7f95d02a-e40f-4e6c-b0ee-835934c8d291\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.502977 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.502951    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f95d02a-e40f-4e6c-b0ee-835934c8d291-maas-api-tls\") pod \"maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq\" (UID: \"7f95d02a-e40f-4e6c-b0ee-835934c8d291\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.511175 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.511154    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84dkj\" (UniqueName: \"kubernetes.io/projected/7f95d02a-e40f-4e6c-b0ee-835934c8d291-kube-api-access-84dkj\") pod \"maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq\" (UID: \"7f95d02a-e40f-4e6c-b0ee-835934c8d291\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.611735 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.611655    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:35.767191 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:35.767155    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"]
Jul 21 20:45:35.770522 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:45:35.770496    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f95d02a_e40f_4e6c_b0ee_835934c8d291.slice/crio-6a8a92734961493fcb9528cc9f74d134d31e470da9d36666f1bd1f25fb1558c6 WatchSource:0}: Error finding container 6a8a92734961493fcb9528cc9f74d134d31e470da9d36666f1bd1f25fb1558c6: Status 404 returned error can't find the container with id 6a8a92734961493fcb9528cc9f74d134d31e470da9d36666f1bd1f25fb1558c6
Jul 21 20:45:36.744385 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:36.744344    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq" event={"ID":"7f95d02a-e40f-4e6c-b0ee-835934c8d291","Type":"ContainerStarted","Data":"0f9b794925ad716425609fb16416649148948463ef839526c901534d7355cb06"}
Jul 21 20:45:36.744810 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:36.744401    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq" event={"ID":"7f95d02a-e40f-4e6c-b0ee-835934c8d291","Type":"ContainerStarted","Data":"6a8a92734961493fcb9528cc9f74d134d31e470da9d36666f1bd1f25fb1558c6"}
Jul 21 20:45:36.744810 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:36.744479    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:45:36.769117 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:36.769063    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq" podStartSLOduration=1.418916062 podStartE2EDuration="1.769044476s" totalImagesPullingTime="350.128414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:45:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:45:36.767558453 +0000 UTC m=+1883.026349387" watchObservedRunningTime="2026-07-21 20:45:36.769044476 +0000 UTC m=+1883.027835399"
Jul 21 20:45:42.754922 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:45:42.754894    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq"
Jul 21 20:46:03.186231 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.186201    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"]
Jul 21 20:46:03.189821 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.189805    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.193956 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.193932    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-672ca14c-serving-cert\""
Jul 21 20:46:03.202843 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.202818    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"]
Jul 21 20:46:03.349313 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.349274    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720671fd-3407-4519-800a-4c8958c5a945-openshift-service-ca\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.349508 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.349320    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdb6x\" (UniqueName: \"kubernetes.io/projected/720671fd-3407-4519-800a-4c8958c5a945-kube-api-access-fdb6x\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.349508 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.349390    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720671fd-3407-4519-800a-4c8958c5a945-maas-api-tls\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.450310 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.450227    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720671fd-3407-4519-800a-4c8958c5a945-openshift-service-ca\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.450310 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.450272    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdb6x\" (UniqueName: \"kubernetes.io/projected/720671fd-3407-4519-800a-4c8958c5a945-kube-api-access-fdb6x\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.450542 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.450393    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720671fd-3407-4519-800a-4c8958c5a945-maas-api-tls\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.450542 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:46:03.450531    2541 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-serving-cert: secret "maas-api-e2e-ait-672ca14c-serving-cert" not found
Jul 21 20:46:03.450623 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:46:03.450609    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720671fd-3407-4519-800a-4c8958c5a945-maas-api-tls podName:720671fd-3407-4519-800a-4c8958c5a945 nodeName:}" failed. No retries permitted until 2026-07-21 20:46:03.950587599 +0000 UTC m=+1910.209378519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/720671fd-3407-4519-800a-4c8958c5a945-maas-api-tls") pod "maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7" (UID: "720671fd-3407-4519-800a-4c8958c5a945") : secret "maas-api-e2e-ait-672ca14c-serving-cert" not found
Jul 21 20:46:03.450941 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.450924    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720671fd-3407-4519-800a-4c8958c5a945-openshift-service-ca\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.463663 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.463636    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdb6x\" (UniqueName: \"kubernetes.io/projected/720671fd-3407-4519-800a-4c8958c5a945-kube-api-access-fdb6x\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.954705 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.954671    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720671fd-3407-4519-800a-4c8958c5a945-maas-api-tls\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:03.957262 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:03.957229    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720671fd-3407-4519-800a-4c8958c5a945-maas-api-tls\") pod \"maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7\" (UID: \"720671fd-3407-4519-800a-4c8958c5a945\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:04.100417 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:04.100381    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:04.238361 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:04.238337    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"]
Jul 21 20:46:04.240570 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:46:04.240545    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720671fd_3407_4519_800a_4c8958c5a945.slice/crio-d4c073e9557235fd74c3be483c006f3b1ed987b96b2cf42aa855b5362770429f WatchSource:0}: Error finding container d4c073e9557235fd74c3be483c006f3b1ed987b96b2cf42aa855b5362770429f: Status 404 returned error can't find the container with id d4c073e9557235fd74c3be483c006f3b1ed987b96b2cf42aa855b5362770429f
Jul 21 20:46:04.878184 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:04.878093    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7" event={"ID":"720671fd-3407-4519-800a-4c8958c5a945","Type":"ContainerStarted","Data":"96d97c812ba5ef13d59666506617302b85ffb5ce76f1be7a5dde145f852f35e6"}
Jul 21 20:46:04.878184 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:04.878146    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7" event={"ID":"720671fd-3407-4519-800a-4c8958c5a945","Type":"ContainerStarted","Data":"d4c073e9557235fd74c3be483c006f3b1ed987b96b2cf42aa855b5362770429f"}
Jul 21 20:46:04.878358 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:04.878199    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:46:04.914531 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:04.914474    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7" podStartSLOduration=1.578592074 podStartE2EDuration="1.914456936s" totalImagesPullingTime="335.864862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:46:04.912274521 +0000 UTC m=+1911.171065445" watchObservedRunningTime="2026-07-21 20:46:04.914456936 +0000 UTC m=+1911.173247860"
Jul 21 20:46:10.887278 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:46:10.887242    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7"
Jul 21 20:48:36.020183 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.020101    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"]
Jul 21 20:48:36.023235 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.023217    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.026388 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.026366    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-3f69897a-serving-cert\""
Jul 21 20:48:36.044846 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.044824    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"]
Jul 21 20:48:36.133028 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.132998    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-maas-api-tls\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.133193 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.133060    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpvrb\" (UniqueName: \"kubernetes.io/projected/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-kube-api-access-xpvrb\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.133193 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.133098    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-openshift-service-ca\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.234499 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.234451    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpvrb\" (UniqueName: \"kubernetes.io/projected/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-kube-api-access-xpvrb\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.234499 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.234501    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-openshift-service-ca\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.234719 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.234573    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-maas-api-tls\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.234762 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:48:36.234712    2541 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-serving-cert: secret "maas-api-e2e-derive-3f69897a-serving-cert" not found
Jul 21 20:48:36.234794 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:48:36.234789    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-maas-api-tls podName:6ec1b7f7-77af-40f0-8fc9-29b569b1c234 nodeName:}" failed. No retries permitted until 2026-07-21 20:48:36.73477233 +0000 UTC m=+2062.993563232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-maas-api-tls") pod "maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg" (UID: "6ec1b7f7-77af-40f0-8fc9-29b569b1c234") : secret "maas-api-e2e-derive-3f69897a-serving-cert" not found
Jul 21 20:48:36.235199 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.235181    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-openshift-service-ca\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.247608 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.247579    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpvrb\" (UniqueName: \"kubernetes.io/projected/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-kube-api-access-xpvrb\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.739955 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.739925    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-maas-api-tls\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.742613 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.742582    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec1b7f7-77af-40f0-8fc9-29b569b1c234-maas-api-tls\") pod \"maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg\" (UID: \"6ec1b7f7-77af-40f0-8fc9-29b569b1c234\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:36.933264 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:36.933228    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:37.066944 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:37.066922    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"]
Jul 21 20:48:37.068790 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:48:37.068754    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec1b7f7_77af_40f0_8fc9_29b569b1c234.slice/crio-437d1798fabaafacff8e461f383d5f40a170b91b5265c26d37c7497abf405973 WatchSource:0}: Error finding container 437d1798fabaafacff8e461f383d5f40a170b91b5265c26d37c7497abf405973: Status 404 returned error can't find the container with id 437d1798fabaafacff8e461f383d5f40a170b91b5265c26d37c7497abf405973
Jul 21 20:48:37.510545 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:37.510466    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg" event={"ID":"6ec1b7f7-77af-40f0-8fc9-29b569b1c234","Type":"ContainerStarted","Data":"437d1798fabaafacff8e461f383d5f40a170b91b5265c26d37c7497abf405973"}
Jul 21 20:48:38.521448 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:38.521392    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg" event={"ID":"6ec1b7f7-77af-40f0-8fc9-29b569b1c234","Type":"ContainerStarted","Data":"0472ab167bce752f7ef391dca708daa3a0a7a6afe2dc9d889e465bf332042007"}
Jul 21 20:48:38.521839 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:38.521506    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:48:38.542351 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:38.542297    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg" podStartSLOduration=2.9454777 podStartE2EDuration="3.542282396s" totalImagesPullingTime="596.804696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:48:38.541295186 +0000 UTC m=+2064.800086122" watchObservedRunningTime="2026-07-21 20:48:38.542282396 +0000 UTC m=+2064.801073319"
Jul 21 20:48:44.530921 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:48:44.530892    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg"
Jul 21 20:50:42.276027 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.275992    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"]
Jul 21 20:50:42.279268 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.279247    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:42.282063 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.282044    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-83e6600b-serving-cert\""
Jul 21 20:50:42.297593 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.297567    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"]
Jul 21 20:50:42.401808 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.401769    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlxdn\" (UniqueName: \"kubernetes.io/projected/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-kube-api-access-vlxdn\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:42.401965 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.401815    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-openshift-service-ca\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:42.401965 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.401920    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-maas-api-tls\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:42.502678 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.502640    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-maas-api-tls\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:42.502845 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.502695    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlxdn\" (UniqueName: \"kubernetes.io/projected/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-kube-api-access-vlxdn\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:42.502845 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:50:42.502768    2541 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-serving-cert: secret "maas-api-e2e-mt-83e6600b-serving-cert" not found
Jul 21 20:50:42.502845 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:50:42.502834    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-maas-api-tls podName:9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2 nodeName:}" failed. No retries permitted until 2026-07-21 20:50:43.00281344 +0000 UTC m=+2189.261604346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-maas-api-tls") pod "maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r" (UID: "9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2") : secret "maas-api-e2e-mt-83e6600b-serving-cert" not found
Jul 21 20:50:42.502945 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.502852    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-openshift-service-ca\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:42.503513 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.503497    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-openshift-service-ca\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:42.519637 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:42.519609    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlxdn\" (UniqueName: \"kubernetes.io/projected/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-kube-api-access-vlxdn\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:43.007152 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:43.007110    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-maas-api-tls\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:43.009636 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:43.009607    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2-maas-api-tls\") pod \"maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r\" (UID: \"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:43.190102 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:43.190064    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:43.327995 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:43.327971    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"]
Jul 21 20:50:43.330166 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:50:43.330138    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b95840c_8b64_4b59_a7b2_1f0c19cd4fa2.slice/crio-f62f270a125780316e0f7d4489f4076f62b635748d57f4501650e7866af9e586 WatchSource:0}: Error finding container f62f270a125780316e0f7d4489f4076f62b635748d57f4501650e7866af9e586: Status 404 returned error can't find the container with id f62f270a125780316e0f7d4489f4076f62b635748d57f4501650e7866af9e586
Jul 21 20:50:43.331534 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:43.331511    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:50:44.064322 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:44.064235    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r" event={"ID":"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2","Type":"ContainerStarted","Data":"85fcb8f2f8d2b693adc78d7c81b981719c1c1feb82e3df34798b0088550baadb"}
Jul 21 20:50:44.064322 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:44.064293    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r" event={"ID":"9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2","Type":"ContainerStarted","Data":"f62f270a125780316e0f7d4489f4076f62b635748d57f4501650e7866af9e586"}
Jul 21 20:50:44.064554 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:44.064333    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:50:44.084954 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:44.084907    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r" podStartSLOduration=1.624224394 podStartE2EDuration="2.084893736s" totalImagesPullingTime="460.669342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:50:44.083181341 +0000 UTC m=+2190.341972265" watchObservedRunningTime="2026-07-21 20:50:44.084893736 +0000 UTC m=+2190.343684658"
Jul 21 20:50:50.074081 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:50:50.074054    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r"
Jul 21 20:51:24.626784 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.626749    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"]
Jul 21 20:51:24.630400 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.630379    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:24.634603 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.634586    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e7adb3ea-serving-cert\""
Jul 21 20:51:24.665728 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.665700    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"]
Jul 21 20:51:24.774089 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.774042    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad24d1b-e717-4d47-a503-d20711d59bf1-openshift-service-ca\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:24.774284 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.774103    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad24d1b-e717-4d47-a503-d20711d59bf1-maas-api-tls\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:24.774284 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.774220    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlwtp\" (UniqueName: \"kubernetes.io/projected/aad24d1b-e717-4d47-a503-d20711d59bf1-kube-api-access-xlwtp\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:24.875112 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.875074    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad24d1b-e717-4d47-a503-d20711d59bf1-openshift-service-ca\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:24.875285 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.875123    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad24d1b-e717-4d47-a503-d20711d59bf1-maas-api-tls\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:24.875285 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.875177    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlwtp\" (UniqueName: \"kubernetes.io/projected/aad24d1b-e717-4d47-a503-d20711d59bf1-kube-api-access-xlwtp\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:24.875378 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:51:24.875289    2541 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-serving-cert: secret "maas-api-e2e-mt-e7adb3ea-serving-cert" not found
Jul 21 20:51:24.875378 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:51:24.875367    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad24d1b-e717-4d47-a503-d20711d59bf1-maas-api-tls podName:aad24d1b-e717-4d47-a503-d20711d59bf1 nodeName:}" failed. No retries permitted until 2026-07-21 20:51:25.375341478 +0000 UTC m=+2231.634132384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aad24d1b-e717-4d47-a503-d20711d59bf1-maas-api-tls") pod "maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4" (UID: "aad24d1b-e717-4d47-a503-d20711d59bf1") : secret "maas-api-e2e-mt-e7adb3ea-serving-cert" not found
Jul 21 20:51:24.875739 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.875722    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad24d1b-e717-4d47-a503-d20711d59bf1-openshift-service-ca\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:24.900360 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:24.900257    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlwtp\" (UniqueName: \"kubernetes.io/projected/aad24d1b-e717-4d47-a503-d20711d59bf1-kube-api-access-xlwtp\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:25.378918 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:25.378880    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad24d1b-e717-4d47-a503-d20711d59bf1-maas-api-tls\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:25.381355 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:25.381331    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad24d1b-e717-4d47-a503-d20711d59bf1-maas-api-tls\") pod \"maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4\" (UID: \"aad24d1b-e717-4d47-a503-d20711d59bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:25.539740 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:25.539710    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:25.686873 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:25.686849    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"]
Jul 21 20:51:25.688827 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:51:25.688804    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad24d1b_e717_4d47_a503_d20711d59bf1.slice/crio-7a898f67b22933095539d25daea92f4974247e0c700ba75b752a549723de4773 WatchSource:0}: Error finding container 7a898f67b22933095539d25daea92f4974247e0c700ba75b752a549723de4773: Status 404 returned error can't find the container with id 7a898f67b22933095539d25daea92f4974247e0c700ba75b752a549723de4773
Jul 21 20:51:26.243291 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:26.243254    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4" event={"ID":"aad24d1b-e717-4d47-a503-d20711d59bf1","Type":"ContainerStarted","Data":"c51df4e3ef28e6545ba2f57d942f59d00bd5ea7a90b0b991e93d8ee176b72ccf"}
Jul 21 20:51:26.243498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:26.243314    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4" event={"ID":"aad24d1b-e717-4d47-a503-d20711d59bf1","Type":"ContainerStarted","Data":"7a898f67b22933095539d25daea92f4974247e0c700ba75b752a549723de4773"}
Jul 21 20:51:26.243498 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:26.243359    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:51:26.270804 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:26.270759    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4" podStartSLOduration=1.8715484230000001 podStartE2EDuration="2.270744011s" totalImagesPullingTime="399.195588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:51:26.268527347 +0000 UTC m=+2232.527318271" watchObservedRunningTime="2026-07-21 20:51:26.270744011 +0000 UTC m=+2232.529534962"
Jul 21 20:51:32.252809 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:51:32.252781    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4"
Jul 21 20:57:45.375171 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.375135    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"]
Jul 21 20:57:45.378514 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.378494    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:45.381547 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.381524    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-351a5d-serving-cert\""
Jul 21 20:57:45.388379 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.388357    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"]
Jul 21 20:57:45.470207 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.470164    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dda0a37d-5b17-4064-94ed-5e7a3437a42f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:45.470395 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.470232    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkcfj\" (UniqueName: \"kubernetes.io/projected/dda0a37d-5b17-4064-94ed-5e7a3437a42f-kube-api-access-zkcfj\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:45.470395 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.470301    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dda0a37d-5b17-4064-94ed-5e7a3437a42f-maas-api-tls\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:45.571313 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.571273    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dda0a37d-5b17-4064-94ed-5e7a3437a42f-maas-api-tls\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:45.571559 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.571345    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dda0a37d-5b17-4064-94ed-5e7a3437a42f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:45.571559 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.571406    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkcfj\" (UniqueName: \"kubernetes.io/projected/dda0a37d-5b17-4064-94ed-5e7a3437a42f-kube-api-access-zkcfj\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:45.571559 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:57:45.571462    2541 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-serving-cert: secret "maas-api-e2e-inf-b-351a5d-serving-cert" not found
Jul 21 20:57:45.571559 ip-10-0-141-220 kubenswrapper[2541]: E0721 20:57:45.571536    2541 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dda0a37d-5b17-4064-94ed-5e7a3437a42f-maas-api-tls podName:dda0a37d-5b17-4064-94ed-5e7a3437a42f nodeName:}" failed. No retries permitted until 2026-07-21 20:57:46.071517275 +0000 UTC m=+2612.330308185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dda0a37d-5b17-4064-94ed-5e7a3437a42f-maas-api-tls") pod "maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527" (UID: "dda0a37d-5b17-4064-94ed-5e7a3437a42f") : secret "maas-api-e2e-inf-b-351a5d-serving-cert" not found
Jul 21 20:57:45.572014 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.571993    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dda0a37d-5b17-4064-94ed-5e7a3437a42f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:45.581821 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:45.581794    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkcfj\" (UniqueName: \"kubernetes.io/projected/dda0a37d-5b17-4064-94ed-5e7a3437a42f-kube-api-access-zkcfj\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:46.075832 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:46.075792    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dda0a37d-5b17-4064-94ed-5e7a3437a42f-maas-api-tls\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:46.078506 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:46.078473    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dda0a37d-5b17-4064-94ed-5e7a3437a42f-maas-api-tls\") pod \"maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527\" (UID: \"dda0a37d-5b17-4064-94ed-5e7a3437a42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:46.289627 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:46.289588    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:46.452461 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:46.452418    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"]
Jul 21 20:57:46.454084 ip-10-0-141-220 kubenswrapper[2541]: W0721 20:57:46.454059    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda0a37d_5b17_4064_94ed_5e7a3437a42f.slice/crio-a0534e44297a39fb0f7c6a7b3de82a2ed7245d1fd7474a83ee6c5e3d75c58f27 WatchSource:0}: Error finding container a0534e44297a39fb0f7c6a7b3de82a2ed7245d1fd7474a83ee6c5e3d75c58f27: Status 404 returned error can't find the container with id a0534e44297a39fb0f7c6a7b3de82a2ed7245d1fd7474a83ee6c5e3d75c58f27
Jul 21 20:57:46.455396 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:46.455369    2541 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:57:46.916892 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:46.916852    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527" event={"ID":"dda0a37d-5b17-4064-94ed-5e7a3437a42f","Type":"ContainerStarted","Data":"3b1e3f7cf78dc3226f5b8318879de8b0f3990a76471049569a200f2b8bafa232"}
Jul 21 20:57:46.917077 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:46.916946    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527" event={"ID":"dda0a37d-5b17-4064-94ed-5e7a3437a42f","Type":"ContainerStarted","Data":"a0534e44297a39fb0f7c6a7b3de82a2ed7245d1fd7474a83ee6c5e3d75c58f27"}
Jul 21 20:57:46.917077 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:46.916977    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:52.930098 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:52.930065    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527"
Jul 21 20:57:52.966017 ip-10-0-141-220 kubenswrapper[2541]: I0721 20:57:52.965954    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527" podStartSLOduration=7.617521157 podStartE2EDuration="7.965938106s" totalImagesPullingTime="348.416949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:57:46.946472662 +0000 UTC m=+2613.205263608" watchObservedRunningTime="2026-07-21 20:57:52.965938106 +0000 UTC m=+2619.224729031"
Jul 21 21:08:17.367995 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:17.367895    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f5b6f4b86-knrz5_816f4822-6e32-440b-8c4a-f9a1e0d3526b/manager/0.log"
Jul 21 21:08:17.846202 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:17.846174    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9bbc76fb-9mkth_645dd1a2-2d04-435e-a1dc-73ca5a7be9af/copy-manifests/0.log"
Jul 21 21:08:17.864869 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:17.864834    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9bbc76fb-9mkth_645dd1a2-2d04-435e-a1dc-73ca5a7be9af/manager/0.log"
Jul 21 21:08:18.372583 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:18.372540    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79888984-htpvl_9f3dbeaf-e8fc-481f-b099-62f1916fddf3/maas-api/0.log"
Jul 21 21:08:18.503006 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:18.502965    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-672ca14c-859cbffc8d-bxpd7_720671fd-3407-4519-800a-4c8958c5a945/maas-api/0.log"
Jul 21 21:08:18.625460 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:18.625367    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-7bc6ce31-75758795dc-mqszm_6204be34-847f-4f7d-a05e-e6afd34aa294/maas-api/0.log"
Jul 21 21:08:18.976977 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:18.976900    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-derive-3f69897a-54d5f8b595-lz2fg_6ec1b7f7-77af-40f0-8fc9-29b569b1c234/maas-api/0.log"
Jul 21 21:08:19.211293 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:19.211259    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-351a5d-8b7fb76c8-sr527_dda0a37d-5b17-4064-94ed-5e7a3437a42f/maas-api/0.log"
Jul 21 21:08:19.338105 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:19.338077    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-868c4ca9-6ff4d459c8-2qlmq_7f95d02a-e40f-4e6c-b0ee-835934c8d291/maas-api/0.log"
Jul 21 21:08:19.456418 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:19.456386    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-83e6600b-66b49bcdd8-qkw5r_9b95840c-8b64-4b59-a7b2-1f0c19cd4fa2/maas-api/0.log"
Jul 21 21:08:19.576099 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:19.576066    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-e7adb3ea-6778476474-hjnc4_aad24d1b-e717-4d47-a503-d20711d59bf1/maas-api/0.log"
Jul 21 21:08:21.161497 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:21.161465    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-n5xp5_3c6c18d1-56ec-4dc3-a8df-6360c0add623/postgres/0.log"
Jul 21 21:08:23.669362 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:23.669330    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bmps8_f00ab062-ca61-4ffc-8020-4e830087e17e/discovery/0.log"
Jul 21 21:08:24.162282 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:24.162232    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-k24j8_7c4de662-8a28-4988-98cd-56ebc38e21e8/payload-pre-processing/0.log"
Jul 21 21:08:24.287193 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:24.287162    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hsmcw_91163d56-6561-4301-9952-389f02cf4670/payload-processing/0.log"
Jul 21 21:08:24.775632 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:24.775598    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wn66d_f5517bfd-1dce-4bcb-a9b9-eddf4bce5fec/main/0.log"
Jul 21 21:08:25.369311 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:25.369284    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-pdpqc_78a23cf8-bb3b-4aac-8ad2-41a41703fbc9/main/0.log"
Jul 21 21:08:33.322143 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:33.322109    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xfxkp_849977c0-4669-47fa-ac22-45fa370aadf4/global-pull-secret-syncer/0.log"
Jul 21 21:08:33.505539 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:33.505504    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x6pj8_df954f93-2c91-4c1b-bb08-21fcadbdb4bd/konnectivity-agent/0.log"
Jul 21 21:08:33.586923 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:33.586840    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-220.ec2.internal_96041acd692d509c9f6a5942e8259028/haproxy/0.log"
Jul 21 21:08:41.921582 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:41.921534    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbsrk_2a5ee90c-7053-4980-b739-04c7854bad15/node-exporter/0.log"
Jul 21 21:08:41.942360 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:41.942331    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbsrk_2a5ee90c-7053-4980-b739-04c7854bad15/kube-rbac-proxy/0.log"
Jul 21 21:08:41.964172 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:41.964149    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbsrk_2a5ee90c-7053-4980-b739-04c7854bad15/init-textfile/0.log"
Jul 21 21:08:42.631108 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:42.631064    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbcd4d7-cc72q_2d9e1f32-b309-46e4-b9e3-5ed70904d6f5/thanos-query/0.log"
Jul 21 21:08:42.653835 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:42.653807    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbcd4d7-cc72q_2d9e1f32-b309-46e4-b9e3-5ed70904d6f5/kube-rbac-proxy-web/0.log"
Jul 21 21:08:42.675568 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:42.675541    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbcd4d7-cc72q_2d9e1f32-b309-46e4-b9e3-5ed70904d6f5/kube-rbac-proxy/0.log"
Jul 21 21:08:42.696195 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:42.696169    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbcd4d7-cc72q_2d9e1f32-b309-46e4-b9e3-5ed70904d6f5/prom-label-proxy/0.log"
Jul 21 21:08:42.716053 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:42.716027    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbcd4d7-cc72q_2d9e1f32-b309-46e4-b9e3-5ed70904d6f5/kube-rbac-proxy-rules/0.log"
Jul 21 21:08:42.736531 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:42.736510    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbcd4d7-cc72q_2d9e1f32-b309-46e4-b9e3-5ed70904d6f5/kube-rbac-proxy-metrics/0.log"
Jul 21 21:08:43.352105 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.352072    2541 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"]
Jul 21 21:08:43.355588 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.355568    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.358382 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.358364    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jgpxl\"/\"kube-root-ca.crt\""
Jul 21 21:08:43.358763 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.358745    2541 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jgpxl\"/\"openshift-service-ca.crt\""
Jul 21 21:08:43.359190 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.359164    2541 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jgpxl\"/\"default-dockercfg-kgt6b\""
Jul 21 21:08:43.367472 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.367450    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"]
Jul 21 21:08:43.509570 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.509543    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-lib-modules\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.509570 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.509574    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-podres\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.509756 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.509598    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-proc\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.509756 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.509672    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-sys\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.509756 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.509699    2541 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdwbr\" (UniqueName: \"kubernetes.io/projected/b162723d-e968-4835-ba01-4b6de8ead12b-kube-api-access-hdwbr\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.610786 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.610704    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-lib-modules\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.610786 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.610750    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-podres\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.610786 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.610782    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-proc\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.611025 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.610832    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-sys\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.611025 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.610839    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-lib-modules\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.611025 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.610861    2541 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdwbr\" (UniqueName: \"kubernetes.io/projected/b162723d-e968-4835-ba01-4b6de8ead12b-kube-api-access-hdwbr\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.611025 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.610892    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-podres\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.611025 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.610901    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-sys\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.611025 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.610892    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b162723d-e968-4835-ba01-4b6de8ead12b-proc\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.620067 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.620041    2541 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdwbr\" (UniqueName: \"kubernetes.io/projected/b162723d-e968-4835-ba01-4b6de8ead12b-kube-api-access-hdwbr\") pod \"perf-node-gather-daemonset-4zkrl\" (UID: \"b162723d-e968-4835-ba01-4b6de8ead12b\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.665664 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.665627    2541 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:43.804149 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.804125    2541 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"]
Jul 21 21:08:43.806096 ip-10-0-141-220 kubenswrapper[2541]: W0721 21:08:43.806070    2541 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb162723d_e968_4835_ba01_4b6de8ead12b.slice/crio-9c8e704ec03a0f2e99e7bc69c04169347e9713994dfded29062db7466955ecb6 WatchSource:0}: Error finding container 9c8e704ec03a0f2e99e7bc69c04169347e9713994dfded29062db7466955ecb6: Status 404 returned error can't find the container with id 9c8e704ec03a0f2e99e7bc69c04169347e9713994dfded29062db7466955ecb6
Jul 21 21:08:43.847073 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:43.847043    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl" event={"ID":"b162723d-e968-4835-ba01-4b6de8ead12b","Type":"ContainerStarted","Data":"9c8e704ec03a0f2e99e7bc69c04169347e9713994dfded29062db7466955ecb6"}
Jul 21 21:08:44.853222 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:44.853181    2541 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl" event={"ID":"b162723d-e968-4835-ba01-4b6de8ead12b","Type":"ContainerStarted","Data":"3522341970bf3fd677d83ea950c97efaa1b7cd989e8914213cb510f5358cb44d"}
Jul 21 21:08:44.853644 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:44.853268    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:45.014704 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:45.014669    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-tp5h7_214dd081-d3cc-4f8e-a11b-82a78823bf11/download-server/0.log"
Jul 21 21:08:46.788807 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:46.788775    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-klr2q_7aad44d0-5d2a-4509-a66d-b232620d3c9c/dns/0.log"
Jul 21 21:08:46.823543 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:46.823511    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-klr2q_7aad44d0-5d2a-4509-a66d-b232620d3c9c/kube-rbac-proxy/0.log"
Jul 21 21:08:46.918530 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:46.918505    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-txw4j_bc89a228-d422-40b1-99e3-3aaaa739c6c7/dns-node-resolver/0.log"
Jul 21 21:08:47.545363 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:47.545336    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bmf5j_1ae0a64e-c4e8-48fc-81cf-68955534f595/node-ca/0.log"
Jul 21 21:08:48.743160 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:48.743122    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bmps8_f00ab062-ca61-4ffc-8020-4e830087e17e/discovery/0.log"
Jul 21 21:08:48.894467 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:48.894413    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-k24j8_7c4de662-8a28-4988-98cd-56ebc38e21e8/payload-pre-processing/0.log"
Jul 21 21:08:48.932172 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:48.932135    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hsmcw_91163d56-6561-4301-9952-389f02cf4670/payload-processing/0.log"
Jul 21 21:08:49.702317 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:49.702289    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lmjmb_16c2289e-1962-4e31-97b8-8b7eb397288c/serve-healthcheck-canary/0.log"
Jul 21 21:08:50.378154 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:50.378121    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7qpd_42d37355-01ab-488b-9500-826ca5f3cce7/kube-rbac-proxy/0.log"
Jul 21 21:08:50.403967 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:50.403939    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7qpd_42d37355-01ab-488b-9500-826ca5f3cce7/exporter/0.log"
Jul 21 21:08:50.431978 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:50.431946    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7qpd_42d37355-01ab-488b-9500-826ca5f3cce7/extractor/0.log"
Jul 21 21:08:50.868929 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:50.868902    2541 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl"
Jul 21 21:08:50.887179 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:50.887122    2541 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-4zkrl" podStartSLOduration=7.887102235 podStartE2EDuration="7.887102235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 21:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:08:44.878480435 +0000 UTC m=+3271.137271361" watchObservedRunningTime="2026-07-21 21:08:50.887102235 +0000 UTC m=+3277.145893165"
Jul 21 21:08:53.202675 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:53.202646    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f5b6f4b86-knrz5_816f4822-6e32-440b-8c4a-f9a1e0d3526b/manager/0.log"
Jul 21 21:08:53.508775 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:53.508745    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9bbc76fb-9mkth_645dd1a2-2d04-435e-a1dc-73ca5a7be9af/manager/0.log"
Jul 21 21:08:53.527799 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:53.527769    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9bbc76fb-9mkth_645dd1a2-2d04-435e-a1dc-73ca5a7be9af/copy-manifests/0.log"
Jul 21 21:08:54.369484 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:54.369452    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bmps8_f00ab062-ca61-4ffc-8020-4e830087e17e/discovery/0.log"
Jul 21 21:08:54.474021 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:54.473986    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-k24j8_7c4de662-8a28-4988-98cd-56ebc38e21e8/payload-pre-processing/0.log"
Jul 21 21:08:54.499303 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:54.499272    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hsmcw_91163d56-6561-4301-9952-389f02cf4670/payload-processing/0.log"
Jul 21 21:08:54.893178 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:54.893125    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-697fc85fc4-tz9sv_52fcf9bf-6623-4593-aa67-752bdc00fe54/manager/0.log"
Jul 21 21:08:56.012471 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:56.012392    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bmps8_f00ab062-ca61-4ffc-8020-4e830087e17e/discovery/0.log"
Jul 21 21:08:56.120884 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:56.120849    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-k24j8_7c4de662-8a28-4988-98cd-56ebc38e21e8/payload-pre-processing/0.log"
Jul 21 21:08:56.147829 ip-10-0-141-220 kubenswrapper[2541]: I0721 21:08:56.147792    2541 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hsmcw_91163d56-6561-4301-9952-389f02cf4670/payload-processing/0.log"