Jul 18 03:50:01.995023 ip-10-0-130-148 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 03:50:02.326723 ip-10-0-130-148 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 03:50:02.326723 ip-10-0-130-148 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 03:50:02.326723 ip-10-0-130-148 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 03:50:02.326723 ip-10-0-130-148 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 03:50:02.326723 ip-10-0-130-148 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 03:50:02.326723 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.326402    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332127    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332285    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332292    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332296    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332299    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332304    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332308    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332311    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332314    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332317    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332320    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332322    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332325    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332328    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332330    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332333    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332336    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332339    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332341    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 03:50:02.342943 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332344    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332347    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332349    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332353    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332356    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332358    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332361    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332364    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332367    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332370    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332373    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332375    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332378    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332381    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332384    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332386    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332390    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332393    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332395    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332398    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 03:50:02.357206 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332401    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332404    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332407    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332409    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332412    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332415    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332417    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332420    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332423    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332425    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332428    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332431    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332434    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332437    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332440    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332443    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332446    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332449    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332451    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 03:50:02.359553 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332454    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332460    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332465    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332468    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332471    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332474    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332476    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332480    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332482    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332485    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332488    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332492    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332497    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332500    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332503    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332507    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332510    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332512    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332515    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 03:50:02.361669 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332518    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332523    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332527    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332530    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332533    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332536    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332540    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332543    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332546    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332549    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332552    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332554    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332557    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332560    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332562    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332565    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332568    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332571    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332574    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 03:50:02.364097 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332577    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332580    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.332582    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333403    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333415    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333419    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333422    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333427    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333432    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333435    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333438    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333442    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333444    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333447    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333450    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333453    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333456    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333458    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333462    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 03:50:02.377164 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333465    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333469    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333472    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333474    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333477    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333480    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333483    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333486    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333488    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333491    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333493    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333496    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333499    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333501    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333505    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333508    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333510    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333513    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333516    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333518    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 03:50:02.379524 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333521    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333524    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333526    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333529    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333531    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333534    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333538    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333541    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333544    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333547    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333550    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333553    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333557    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333560    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333563    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333566    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333569    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333572    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333575    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333577    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 03:50:02.381359 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333580    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333582    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333584    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333587    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333590    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333592    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333595    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333597    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333600    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333602    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333604    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333607    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333609    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333612    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333615    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333617    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333619    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333622    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333624    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 03:50:02.383800 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333627    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333630    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333633    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333635    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333638    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333641    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333665    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333670    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333675    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333678    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333681    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333685    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333689    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333692    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333694    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333697    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333699    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333702    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333704    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 03:50:02.605539 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333707    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 03:50:02.396805 ip-10-0-130-148 systemd[1]: Started Kubernetes Kubelet.
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333710    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333712    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333714    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.333717    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334125    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334131    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334134    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334136    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334139    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334142    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334145    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334147    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334150    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334153    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334156    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334159    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334162    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334165    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 03:50:02.634473 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334167    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334170    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334173    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334177    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334181    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334185    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334188    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334191    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334194    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334197    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334200    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334203    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334205    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334208    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334211    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334214    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334216    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334219    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334221    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334224    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 03:50:02.640050 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334227    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334229    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334232    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334234    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334242    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334244    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334246    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334249    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334251    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334254    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334257    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334259    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334262    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334265    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334267    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334272    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334274    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334277    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334280    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334283    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 03:50:02.640797 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334285    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334288    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334292    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334295    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334298    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334301    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334304    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334306    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334309    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334312    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334314    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334317    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334319    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334322    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334325    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334327    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334331    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334334    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334336    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334339    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 03:50:02.641407 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334341    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334344    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334346    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334349    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334351    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334354    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334356    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334359    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334362    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334364    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334367    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334369    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334372    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334375    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334377    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334382    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334384    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334387    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334391    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 03:50:02.642086 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334395    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334397    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334399    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334402    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334405    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.334407    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334480    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334488    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334495    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334500    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334505    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334509    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334513    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334518    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334521    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334524    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334528    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334531    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334534    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334537    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334540    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334543    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334547    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 03:50:02.642676 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334550    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334554    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334557    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334560    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334563    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334569    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334573    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334576    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334579    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334583    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334586    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334589    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334592    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334595    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334598    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334602    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334606    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334609    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334612    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334616    2559 flags.go:64] FLAG: --enable-server="true"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334619    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334627    2559 flags.go:64] FLAG: --event-burst="100"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334630    2559 flags.go:64] FLAG: --event-qps="50"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334633    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 03:50:02.643377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334636    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334639    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334643    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334665    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334671    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334674    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334677    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334680    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334684    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334687    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334690    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334693    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334696    2559 flags.go:64] FLAG: --feature-gates=""
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334702    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334705    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334708    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334711    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334714    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334717    2559 flags.go:64] FLAG: --help="false"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334720    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334724    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334727    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334730    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334733    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 03:50:02.644144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334737    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334740    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334744    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334747    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334750    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334753    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334756    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334759    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334762    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334765    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334768    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334771    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334773    2559 flags.go:64] FLAG: --lock-file=""
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334776    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334779    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334782    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334788    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334791    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334794    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334797    2559 flags.go:64] FLAG: --logging-format="text"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334799    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334804    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334807    2559 flags.go:64] FLAG: --manifest-url=""
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334810    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334814    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 03:50:02.645028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334817    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334822    2559 flags.go:64] FLAG: --max-pods="110"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334825    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334828    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334831    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334834    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334837    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334840    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334843    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334851    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334855    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334858    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334861    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334864    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334869    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334872    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334875    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334878    2559 flags.go:64] FLAG: --port="10250"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334881    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334884    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-082c031387307bcca"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334887    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334890    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334893    2559 flags.go:64] FLAG: --register-node="true"
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334896    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 18 03:50:02.645933 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334899    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334903    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334906    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334908    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334914    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334917    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334920    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334923    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334926    2559 flags.go:64] FLAG: --runonce="false"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334929    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334933    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334936    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334939    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334942    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334945    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334948    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334951    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334954    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334958    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334961    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334964    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334968    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334971    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334973    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334979    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 03:50:02.646708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334981    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334984    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334988    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334991    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334994    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.334997    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.335000    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.335003    2559 flags.go:64] FLAG: --v="2"
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.335007    2559 flags.go:64] FLAG: --version="false"
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.335012    2559 flags.go:64] FLAG: --vmodule=""
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.335016    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.335021    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335139    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335144    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335147    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335150    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335153    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335155    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335158    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335161    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335163    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335166    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335169    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 03:50:02.647412 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335172    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335175    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335179    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335181    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335184    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335187    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335189    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335192    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335195    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335198    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335202    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335204    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335207    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335210    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335213    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335215    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335218    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335220    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335223    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 03:50:02.648147 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335227    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335232    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335235    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335238    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335241    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335244    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335247    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335249    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335252    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335255    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335257    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335260    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335262    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335265    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335267    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335271    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335274    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335278    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335281    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335284    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 03:50:02.648679 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335287    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335289    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335292    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335295    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335297    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335300    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335302    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335305    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335307    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335310    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335312    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335315    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335318    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335323    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335325    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335328    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335330    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335333    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335335    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335338    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 03:50:02.649264 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335340    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335343    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335345    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335348    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335350    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335353    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335355    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335359    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335361    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335364    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335367    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335369    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335372    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335374    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335377    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335379    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335382    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335384    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335387    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 03:50:02.649830 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335390    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335392    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335395    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335397    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335400    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335402    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335406    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335409    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335411    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.335414    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.336008    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.345057    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.345083    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.345734    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 03:50:02.650377 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.345743    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345806    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345812    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345816    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345819    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345822    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345825    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345831    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345834    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345837    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345840    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345843    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345846    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345851    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345855    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345858    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345861    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345864    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345867    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 03:50:02.650801 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345869    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345872    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345875    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345877    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345880    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345885    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345888    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345890    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345893    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345896    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345898    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345902    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345905    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345908    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345910    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345913    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345916    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345918    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345921    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345923    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 03:50:02.651340 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345928    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345930    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345933    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345936    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345938    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345941    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345944    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345946    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345949    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345951    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345954    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345956    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345959    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345961    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345964    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345967    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345969    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345973    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345975    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345978    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 03:50:02.651938 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345980    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345984    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345986    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345989    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345992    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345995    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.345997    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346000    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346002    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346005    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346007    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346010    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346014    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346016    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346019    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346022    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346024    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346028    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346032    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346035    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 03:50:02.656501 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346038    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346041    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346044    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346047    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346050    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346053    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346055    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346058    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346060    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346065    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346067    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346070    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346073    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346075    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346078    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346080    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346083    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346086    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346090    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 03:50:02.808999 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346093    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346096    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.346101    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346218    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346223    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346226    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346230    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346233    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346236    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346239    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346242    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346246    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346249    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346252    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 03:50:02.812452 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346255    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346257    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346260    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346262    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346265    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346267    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346270    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346272    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346276    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346279    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346281    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346284    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346286    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346289    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346291    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346294    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346296    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346299    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346303    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 03:50:02.819310 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346307    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346310    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346313    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346315    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346318    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346322    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346325    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346327    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346330    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346332    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346335    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346338    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346340    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346343    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346345    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346348    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346350    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346353    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346355    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346358    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 03:50:02.820350 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346360    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346364    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346367    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346369    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346372    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346375    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346377    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346379    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346382    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346384    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346387    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346390    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346392    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346395    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346398    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346400    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346402    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346407    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346410    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346413    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346415    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 03:50:02.821193 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346418    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346420    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346423    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346425    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346428    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346430    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346433    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346435    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346438    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346441    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346443    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346446    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346450    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346453    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346455    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346457    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346460    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346463    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346465    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 03:50:02.822016 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346468    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346471    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346473    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346476    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346479    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346482    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346484    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346487    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:02.346489    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.346496    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.346635    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.348736    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.349909    2559 server.go:1019] "Starting client certificate rotation"
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.350006    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 03:50:02.822912 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.350683    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 03:50:02.823885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.352073    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 03:50:02.823885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.355842    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 03:50:02.823885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.363785    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 18 03:50:02.823885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.366808    2559 log.go:25] "Validated CRI v1 image API"
Jul 18 03:50:02.823885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.367560    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 03:50:02.823885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.369603    2559 fs.go:135] Filesystem UUIDs: map[1c43b63d-591b-47f6-a271-647c8038b1df:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fdfbe979-375d-488f-89ee-217bf07611f9:/dev/nvme0n1p4]
Jul 18 03:50:02.823885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.369621    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.374546    2559 manager.go:216] Machine: {Timestamp:2026-07-18 03:50:02.373396686 +0000 UTC m=+0.269581889 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098805 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c754da7f7c6d8a0318b241d607c32 SystemUUID:ec2c754d-a7f7-c6d8-a031-8b241d607c32 BootID:ed66a86e-7c39-45d0-8802-e44ca3ac797f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:7f:ce:42:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:7f:ce:42:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:1a:3b:32:6b:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.374680    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.374808    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.376669    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.377373    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.377414    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-148.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.378623    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.378639    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.378664    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.379188    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.380429    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.384395    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.384565    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.384615    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.384633    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.384661    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 03:50:02.824524 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.384679    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.384688    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.385087    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.385106    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.387047    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.389082    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.389110    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390085    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390098    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390104    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390110    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390118    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390124    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390138    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390146    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390154    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390160    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390173    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.390178    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.391506    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.391815    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.394349    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-148.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.394375    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.394419    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.395855    2559 server.go:1268] "Started kubelet"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.395955    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.395942    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.396030    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.397490    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.397786    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.397985    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rd64q"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.400109    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-148.ec2.internal.18c345c7eff9fdbd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-148.ec2.internal,UID:ip-10-0-130-148.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-148.ec2.internal,},FirstTimestamp:2026-07-18 03:50:02.395794877 +0000 UTC m=+0.291980059,LastTimestamp:2026-07-18 03:50:02.395794877 +0000 UTC m=+0.291980059,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-148.ec2.internal,}"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.401333    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.403985    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.403986    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.404084    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.404530    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.404533    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.404545    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.404666    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 03:50:02.825355 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.404674    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.404894    2559 factory.go:55] Registering systemd factory
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.404911    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.404996    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rd64q"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.405164    2559 factory.go:153] Registering CRI-O factory
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.405178    2559 factory.go:223] Registration of the crio container factory successfully
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.405236    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.405258    2559 factory.go:103] Registering Raw factory
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.405270    2559 manager.go:1196] Started watching for new ooms in manager
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.405670    2559 manager.go:349] Starting recovery of all containers
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.406848    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.406921    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.417127    2559 manager.go:354] Recovery completed
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.422289    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.424367    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.424394    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.424407    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientPID"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.424987    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.425001    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.425015    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.425019    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.425683    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.425707    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.425717    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientPID"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.426994    2559 policy_none.go:49] "None policy: Start"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.427009    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.427019    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.429003    2559 policy_none.go:47] "Start"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.478391    2559 manager.go:337] "Starting Device Plugin manager"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.478433    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.478445    2559 server.go:87] "Starting device plugin registration server"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.478752    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.478763    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.478874    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.478984    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.478994    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.479348    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.479405    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.507487    2559 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2593 into the system container \"/system.slice\": <nil>"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.579270    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.580282    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.580310    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.580320    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientPID"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.580348    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.587635    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.826825 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.587667    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-148.ec2.internal\": node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.600910    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.674743    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.676282    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.676323    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.676344    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.676380    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.678567    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.701373    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.776693    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal"]
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.776784    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.778440    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.778468    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.778477    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientPID"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.780748    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.780862    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.780890    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.781542    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.781572    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.781587    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientPID"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.781587    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.781616    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.781629    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientPID"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.783924    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.783955    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.784679    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.784702    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.784716    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeHasSufficientPID"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.801771    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.807159    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70d74643bae6540b1cf9e89d4caeb41c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal\" (UID: \"70d74643bae6540b1cf9e89d4caeb41c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.807197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70d74643bae6540b1cf9e89d4caeb41c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal\" (UID: \"70d74643bae6540b1cf9e89d4caeb41c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.807213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac85b0e2c258f1bb28fc0a607b6ac4d7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-148.ec2.internal\" (UID: \"ac85b0e2c258f1bb28fc0a607b6ac4d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.815391    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-148.ec2.internal\" not found" node="ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.828276 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.819832    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-148.ec2.internal\" not found" node="ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.910253 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:02.902014    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:02.910253 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.908360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70d74643bae6540b1cf9e89d4caeb41c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal\" (UID: \"70d74643bae6540b1cf9e89d4caeb41c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.910253 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.908400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70d74643bae6540b1cf9e89d4caeb41c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal\" (UID: \"70d74643bae6540b1cf9e89d4caeb41c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.910253 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.908424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac85b0e2c258f1bb28fc0a607b6ac4d7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-148.ec2.internal\" (UID: \"ac85b0e2c258f1bb28fc0a607b6ac4d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.910253 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.908453    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70d74643bae6540b1cf9e89d4caeb41c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal\" (UID: \"70d74643bae6540b1cf9e89d4caeb41c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.910253 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.908459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac85b0e2c258f1bb28fc0a607b6ac4d7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-148.ec2.internal\" (UID: \"ac85b0e2c258f1bb28fc0a607b6ac4d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:02.910253 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:02.908465    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70d74643bae6540b1cf9e89d4caeb41c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal\" (UID: \"70d74643bae6540b1cf9e89d4caeb41c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:03.081533 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:03.002525    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:03.187109 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:03.103059    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:03.187109 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.118560    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:03.187109 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.122749    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:03.343591 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:03.203873    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:03.343591 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.284555    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 03:50:03.343591 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:03.304547    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:03.521382 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.349928    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 03:50:03.521382 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.350094    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 03:50:03.521382 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.350109    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 03:50:03.521382 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:03.404623    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:03.521382 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.409461    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 03:45:03 +0000 UTC" deadline="2028-04-09 09:19:22.586548012 +0000 UTC"
Jul 18 03:50:03.521382 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.409504    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15149h29m19.177046349s"
Jul 18 03:50:03.521382 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:03.505820    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:03.681501 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:03.609975    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:03.834207 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:03.711094    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:03.834207 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:03.778208    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d74643bae6540b1cf9e89d4caeb41c.slice/crio-6a8df8862b3a8622b89ba16f715f33abbaea88b2d258498a81efb45b44ecca67 WatchSource:0}: Error finding container 6a8df8862b3a8622b89ba16f715f33abbaea88b2d258498a81efb45b44ecca67: Status 404 returned error can't find the container with id 6a8df8862b3a8622b89ba16f715f33abbaea88b2d258498a81efb45b44ecca67
Jul 18 03:50:03.834207 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:03.786257    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac85b0e2c258f1bb28fc0a607b6ac4d7.slice/crio-1f751381c4e8e39ea37d5d3d0d4e2c7779de2b852955da26892f15a1cd0e707c WatchSource:0}: Error finding container 1f751381c4e8e39ea37d5d3d0d4e2c7779de2b852955da26892f15a1cd0e707c: Status 404 returned error can't find the container with id 1f751381c4e8e39ea37d5d3d0d4e2c7779de2b852955da26892f15a1cd0e707c
Jul 18 03:50:03.834207 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.788321    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 03:50:03.834207 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.801312    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 03:50:03.834207 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:03.811725    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-148.ec2.internal\" not found"
Jul 18 03:50:03.992123 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:03.909784    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 03:50:04.147803 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.005131    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:04.147803 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.016372    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 03:50:04.147803 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.017890    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal"
Jul 18 03:50:04.147803 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.023295    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 03:50:04.385745 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.385714    2559 apiserver.go:52] "Watching apiserver"
Jul 18 03:50:04.392844 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.391797    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 03:50:04.392844 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.392370    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal","openshift-multus/multus-additional-cni-plugins-tnp6s","openshift-multus/network-metrics-daemon-48dcs","openshift-ovn-kubernetes/ovnkube-node-7d9sr","kube-system/global-pull-secret-syncer-bl8ng","kube-system/konnectivity-agent-jdpnj","openshift-cluster-node-tuning-operator/tuned-srjtq","openshift-dns/node-resolver-mtcnq","openshift-image-registry/node-ca-p7ld9","openshift-multus/multus-h4dcs","openshift-network-diagnostics/network-check-target-d22vr","openshift-network-operator/iptables-alerter-q922s"]
Jul 18 03:50:04.395593 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.395519    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:04.395747 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.395620    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:04.398877 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.398747    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:04.398877 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.398835    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:04.401652 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.401193    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.403450 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.403425    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 03:50:04.404864 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.403779    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f9g24\""
Jul 18 03:50:04.404864 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.403993    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 03:50:04.404864 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.404332    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 03:50:04.404864 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.404504    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 03:50:04.405825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.405355    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.406557 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.406292    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:04.406557 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.406375    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:04.408161 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.407208    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 03:50:04.408161 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.407583    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 03:50:04.408161 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.407807    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 03:50:04.408161 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.407931    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 03:50:04.408161 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.407936    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 03:50:04.408161 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.408046    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t9xp2\""
Jul 18 03:50:04.411142 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.408967    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.412295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.411577    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 03:50:04.412295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.411841    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 03:50:04.412295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.412201    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 03:50:04.412918 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.412888    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 03:50:04.413630 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.413610    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 03:50:04.415229 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.414036    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rk5xs\""
Jul 18 03:50:04.415229 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.414417    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 03:50:04.416209 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.415454    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:04.416319 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.416273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.417812 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.417794    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.418119 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.418099    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 03:50:04.418707 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.418604    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 03:50:04.418838 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.418818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rr4hc\""
Jul 18 03:50:04.420412 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.420275    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 03:50:04.421120 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.420707    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 03:50:04.421120 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.420729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 03:50:04.421120 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.420811    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 03:50:04.421120 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.420981    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tzvx5\""
Jul 18 03:50:04.421120 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.420985    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 03:50:04.421120 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.421113    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5b82r\""
Jul 18 03:50:04.421975 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.421930    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 03:50:04.422658 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.422283    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.423314 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.423270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8efa1cd9-f09e-4141-9316-ab2a3d47b404-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.423555 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.423534    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ppzq\" (UniqueName: \"kubernetes.io/projected/8efa1cd9-f09e-4141-9316-ab2a3d47b404-kube-api-access-6ppzq\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.423726 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.423708    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-system-cni-dir\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.424088 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424068    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 03:50:04.424400 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424381    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tpzqv\""
Jul 18 03:50:04.424555 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:04.424640 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz55n\" (UniqueName: \"kubernetes.io/projected/65190cd9-1a6c-4358-9309-30c238568f7a-kube-api-access-wz55n\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:04.424640 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f3991d8-3ae2-49e2-af88-6c5fc43b4e37-iptables-alerter-script\") pod \"iptables-alerter-q922s\" (UID: \"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37\") " pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.424779 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.424779 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424671    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 03:50:04.424779 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-kubelet-config\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:04.424779 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f3991d8-3ae2-49e2-af88-6c5fc43b4e37-host-slash\") pod \"iptables-alerter-q922s\" (UID: \"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37\") " pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.424995 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwsr2\" (UniqueName: \"kubernetes.io/projected/7f3991d8-3ae2-49e2-af88-6c5fc43b4e37-kube-api-access-rwsr2\") pod \"iptables-alerter-q922s\" (UID: \"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37\") " pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.424995 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-cnibin\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.424995 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8efa1cd9-f09e-4141-9316-ab2a3d47b404-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.424995 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424853    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-dbus\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:04.424995 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:04.424995 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:04.424995 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-os-release\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.424995 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.424995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8efa1cd9-f09e-4141-9316-ab2a3d47b404-cni-binary-copy\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.425391 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.425065    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.427143 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.426954    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 03:50:04.427393 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.427240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.427393 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.427331    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 03:50:04.427393 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.427380    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 03:50:04.428040 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.427917    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9dq85\""
Jul 18 03:50:04.429396 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.429376    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mxjgr\""
Jul 18 03:50:04.429581 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.429564    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 03:50:04.438925 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.438899    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sddrz"
Jul 18 03:50:04.447931 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.447899    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sddrz"
Jul 18 03:50:04.506144 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.506060    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 03:50:04.525944 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.525912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0717052e-a7b0-42f8-8a5d-473afb719b7c-konnectivity-ca\") pod \"konnectivity-agent-jdpnj\" (UID: \"0717052e-a7b0-42f8-8a5d-473afb719b7c\") " pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:04.526135 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.525959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-os-release\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.526135 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.525983    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-cni-netd\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.526135 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-kubernetes\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.526135 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-os-release\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.526366 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-systemd\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.526366 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-run\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.526366 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-var-lib-kubelet\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.526366 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-tmp\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.526366 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-system-cni-dir\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.526366 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-var-lib-openvswitch\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.526366 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526347    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-ovnkube-config\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.526366 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-system-cni-dir\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.526755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-ovn-node-metrics-cert\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.526755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526438    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-sys-fs\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.526755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526495    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmxn\" (UniqueName: \"kubernetes.io/projected/0758e022-73b9-4f35-96e8-5d297cb56356-kube-api-access-vcmxn\") pod \"node-resolver-mtcnq\" (UID: \"0758e022-73b9-4f35-96e8-5d297cb56356\") " pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.526755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-cni-dir\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.526755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-cnibin\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.526755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-kubelet-config\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:04.526755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-sysctl-conf\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.526755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526700    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8efa1cd9-f09e-4141-9316-ab2a3d47b404-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.526755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526753    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-etc-openvswitch\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.527189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526783    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-run-netns\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.527189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-var-lib-cni-bin\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.527189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526838    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-node-log\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.527189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.526988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-conf-dir\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.527189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:04.527189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz55n\" (UniqueName: \"kubernetes.io/projected/65190cd9-1a6c-4358-9309-30c238568f7a-kube-api-access-wz55n\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:04.527189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.527189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.527189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0758e022-73b9-4f35-96e8-5d297cb56356-tmp-dir\") pod \"node-resolver-mtcnq\" (UID: \"0758e022-73b9-4f35-96e8-5d297cb56356\") " pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56sqk\" (UniqueName: \"kubernetes.io/projected/958b9f76-31bd-4650-9982-96e485a636b9-kube-api-access-56sqk\") pod \"node-ca-p7ld9\" (UID: \"958b9f76-31bd-4650-9982-96e485a636b9\") " pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-var-lib-cni-multus\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f3991d8-3ae2-49e2-af88-6c5fc43b4e37-iptables-alerter-script\") pod \"iptables-alerter-q922s\" (UID: \"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37\") " pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-run-systemd\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-run-k8s-cni-cncf-io\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-etc-kubernetes\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-run-openvswitch\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f3991d8-3ae2-49e2-af88-6c5fc43b4e37-host-slash\") pod \"iptables-alerter-q922s\" (UID: \"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37\") " pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527524    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-ovnkube-script-lib\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527552    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8efa1cd9-f09e-4141-9316-ab2a3d47b404-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.527567    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:04.527638 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.527637    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:50:05.027611394 +0000 UTC m=+2.923796567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-kubelet-config\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-modprobe-d\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-host\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527875    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-systemd-units\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlvkh\" (UniqueName: \"kubernetes.io/projected/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-kube-api-access-dlvkh\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-tuned\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.527981    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.528042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-registration-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.528072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-os-release\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.528098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-socket-dir-parent\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.528144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-lib-modules\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.528358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.528198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpd2s\" (UniqueName: \"kubernetes.io/projected/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-kube-api-access-fpd2s\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.529885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.529123    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f3991d8-3ae2-49e2-af88-6c5fc43b4e37-host-slash\") pod \"iptables-alerter-q922s\" (UID: \"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37\") " pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.529885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.529189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f3991d8-3ae2-49e2-af88-6c5fc43b4e37-iptables-alerter-script\") pod \"iptables-alerter-q922s\" (UID: \"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37\") " pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530195    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-cni-binary-copy\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-var-lib-kubelet\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-socket-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530396    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-daemon-config\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z2rk\" (UniqueName: \"kubernetes.io/projected/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-kube-api-access-7z2rk\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwsr2\" (UniqueName: \"kubernetes.io/projected/7f3991d8-3ae2-49e2-af88-6c5fc43b4e37-kube-api-access-rwsr2\") pod \"iptables-alerter-q922s\" (UID: \"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37\") " pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-cnibin\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-cni-bin\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530790    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-cnibin\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.530859    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:04.533647 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.530874    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8efa1cd9-f09e-4141-9316-ab2a3d47b404-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.534389 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.533689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-device-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.534389 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.533783    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret podName:a61c4a15-f6f1-4663-a64c-85f4cd9465d9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:05.033758922 +0000 UTC m=+2.929944094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret") pod "global-pull-secret-syncer-bl8ng" (UID: "a61c4a15-f6f1-4663-a64c-85f4cd9465d9") : object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:04.534389 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.533810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8efa1cd9-f09e-4141-9316-ab2a3d47b404-cni-binary-copy\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.534389 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.533843    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8efa1cd9-f09e-4141-9316-ab2a3d47b404-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.534389 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.533878    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ppzq\" (UniqueName: \"kubernetes.io/projected/8efa1cd9-f09e-4141-9316-ab2a3d47b404-kube-api-access-6ppzq\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.534389 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.533913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-run-netns\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.534389 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.533943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-run-ovn-kubernetes\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.534389 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-sys\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.534389 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534367    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0717052e-a7b0-42f8-8a5d-473afb719b7c-agent-certs\") pod \"konnectivity-agent-jdpnj\" (UID: \"0717052e-a7b0-42f8-8a5d-473afb719b7c\") " pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:04.534792 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0758e022-73b9-4f35-96e8-5d297cb56356-hosts-file\") pod \"node-resolver-mtcnq\" (UID: \"0758e022-73b9-4f35-96e8-5d297cb56356\") " pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.534792 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534472    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-sysctl-d\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.534792 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/958b9f76-31bd-4650-9982-96e485a636b9-serviceca\") pod \"node-ca-p7ld9\" (UID: \"958b9f76-31bd-4650-9982-96e485a636b9\") " pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.534792 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-run-multus-certs\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.534792 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-kubelet\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.534792 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-slash\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.534792 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534753    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-log-socket\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.535061 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534750    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8efa1cd9-f09e-4141-9316-ab2a3d47b404-cni-binary-copy\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.535061 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534787    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-env-overrides\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.535061 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mzdn\" (UniqueName: \"kubernetes.io/projected/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-kube-api-access-5mzdn\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.535061 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-system-cni-dir\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.535061 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-hostroot\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.535061 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.534966    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8efa1cd9-f09e-4141-9316-ab2a3d47b404-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.535061 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.535019    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-dbus\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:04.535336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.535064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-run-ovn\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.535336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.535111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-sysconfig\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.535336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.535144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/958b9f76-31bd-4650-9982-96e485a636b9-host\") pod \"node-ca-p7ld9\" (UID: \"958b9f76-31bd-4650-9982-96e485a636b9\") " pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.535336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.535213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-dbus\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:04.536309 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.536267    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 03:50:04.541166 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.541103    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz55n\" (UniqueName: \"kubernetes.io/projected/65190cd9-1a6c-4358-9309-30c238568f7a-kube-api-access-wz55n\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:04.545423 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.545390    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 03:50:04.545423 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.545425    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 03:50:04.545633 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.545441    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h4c9k for pod openshift-network-diagnostics/network-check-target-d22vr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:04.545633 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:04.545584    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k podName:c92d63cc-b133-4038-a182-4ca3704232bc nodeName:}" failed. No retries permitted until 2026-07-18 03:50:05.04556246 +0000 UTC m=+2.941747646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h4c9k" (UniqueName: "kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k") pod "network-check-target-d22vr" (UID: "c92d63cc-b133-4038-a182-4ca3704232bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:04.548727 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.548693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwsr2\" (UniqueName: \"kubernetes.io/projected/7f3991d8-3ae2-49e2-af88-6c5fc43b4e37-kube-api-access-rwsr2\") pod \"iptables-alerter-q922s\" (UID: \"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37\") " pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.560460 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.560427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ppzq\" (UniqueName: \"kubernetes.io/projected/8efa1cd9-f09e-4141-9316-ab2a3d47b404-kube-api-access-6ppzq\") pod \"multus-additional-cni-plugins-tnp6s\" (UID: \"8efa1cd9-f09e-4141-9316-ab2a3d47b404\") " pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56sqk\" (UniqueName: \"kubernetes.io/projected/958b9f76-31bd-4650-9982-96e485a636b9-kube-api-access-56sqk\") pod \"node-ca-p7ld9\" (UID: \"958b9f76-31bd-4650-9982-96e485a636b9\") " pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-var-lib-cni-multus\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635591    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-run-systemd\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-run-k8s-cni-cncf-io\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-etc-kubernetes\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-run-openvswitch\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-ovnkube-script-lib\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-modprobe-d\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-host\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-systemd-units\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlvkh\" (UniqueName: \"kubernetes.io/projected/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-kube-api-access-dlvkh\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-tuned\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635904    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-registration-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-os-release\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-socket-dir-parent\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.636336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.635998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-lib-modules\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpd2s\" (UniqueName: \"kubernetes.io/projected/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-kube-api-access-fpd2s\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-cni-binary-copy\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636092    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-var-lib-kubelet\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-socket-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-daemon-config\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z2rk\" (UniqueName: \"kubernetes.io/projected/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-kube-api-access-7z2rk\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-cni-bin\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-device-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-run-netns\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-run-ovn-kubernetes\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-sys\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0717052e-a7b0-42f8-8a5d-473afb719b7c-agent-certs\") pod \"konnectivity-agent-jdpnj\" (UID: \"0717052e-a7b0-42f8-8a5d-473afb719b7c\") " pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636343    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0758e022-73b9-4f35-96e8-5d297cb56356-hosts-file\") pod \"node-resolver-mtcnq\" (UID: \"0758e022-73b9-4f35-96e8-5d297cb56356\") " pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-sysctl-d\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/958b9f76-31bd-4650-9982-96e485a636b9-serviceca\") pod \"node-ca-p7ld9\" (UID: \"958b9f76-31bd-4650-9982-96e485a636b9\") " pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-run-multus-certs\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.637373 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636446    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-kubelet\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-slash\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-log-socket\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-env-overrides\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzdn\" (UniqueName: \"kubernetes.io/projected/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-kube-api-access-5mzdn\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636537    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-ovnkube-script-lib\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-system-cni-dir\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-hostroot\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-run-ovn\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-var-lib-cni-multus\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-sysconfig\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/958b9f76-31bd-4650-9982-96e485a636b9-host\") pod \"node-ca-p7ld9\" (UID: \"958b9f76-31bd-4650-9982-96e485a636b9\") " pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636670    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-run-k8s-cni-cncf-io\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636844    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-sys\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636917    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-systemd-units\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0717052e-a7b0-42f8-8a5d-473afb719b7c-konnectivity-ca\") pod \"konnectivity-agent-jdpnj\" (UID: \"0717052e-a7b0-42f8-8a5d-473afb719b7c\") " pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-host\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637320    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-etc-kubernetes\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.638289 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-run-openvswitch\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0717052e-a7b0-42f8-8a5d-473afb719b7c-konnectivity-ca\") pod \"konnectivity-agent-jdpnj\" (UID: \"0717052e-a7b0-42f8-8a5d-473afb719b7c\") " pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-cni-netd\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-kubernetes\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637452    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-systemd\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-run\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637525    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-run\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-run-multus-certs\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-var-lib-kubelet\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-tmp\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637640    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-modprobe-d\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-cni-netd\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-var-lib-openvswitch\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637725    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-var-lib-openvswitch\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-ovnkube-config\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637772    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-ovn-node-metrics-cert\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-sys-fs\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmxn\" (UniqueName: \"kubernetes.io/projected/0758e022-73b9-4f35-96e8-5d297cb56356-kube-api-access-vcmxn\") pod \"node-resolver-mtcnq\" (UID: \"0758e022-73b9-4f35-96e8-5d297cb56356\") " pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.639324 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637858    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-env-overrides\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637868    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-sysctl-d\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-cni-dir\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-cni-dir\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-cnibin\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-sysctl-conf\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.637976    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-kubernetes\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-etc-openvswitch\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-systemd\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-run-netns\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-var-lib-cni-bin\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638098    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-node-log\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-conf-dir\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0758e022-73b9-4f35-96e8-5d297cb56356-tmp-dir\") pod \"node-resolver-mtcnq\" (UID: \"0758e022-73b9-4f35-96e8-5d297cb56356\") " pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/958b9f76-31bd-4650-9982-96e485a636b9-serviceca\") pod \"node-ca-p7ld9\" (UID: \"958b9f76-31bd-4650-9982-96e485a636b9\") " pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-var-lib-kubelet\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.640370 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-ovnkube-config\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638586    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0758e022-73b9-4f35-96e8-5d297cb56356-tmp-dir\") pod \"node-resolver-mtcnq\" (UID: \"0758e022-73b9-4f35-96e8-5d297cb56356\") " pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0758e022-73b9-4f35-96e8-5d297cb56356-hosts-file\") pod \"node-resolver-mtcnq\" (UID: \"0758e022-73b9-4f35-96e8-5d297cb56356\") " pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-kubelet\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638701    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-log-socket\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638778    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-sys-fs\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.638808    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-run-ovn\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639034    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-system-cni-dir\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-hostroot\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639141    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/958b9f76-31bd-4650-9982-96e485a636b9-host\") pod \"node-ca-p7ld9\" (UID: \"958b9f76-31bd-4650-9982-96e485a636b9\") " pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639193    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-sysconfig\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-var-lib-kubelet\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.636642    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-run-systemd\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639398    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-run-netns\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639458    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-registration-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639472    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-conf-dir\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639461    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-etc-openvswitch\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-socket-dir-parent\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.641295 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639532    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-host-var-lib-cni-bin\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639561    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-cnibin\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639574    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-node-log\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-sysctl-conf\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-os-release\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639667    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-cni-bin\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639676    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639785    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-socket-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.639816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-lib-modules\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.640168    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0717052e-a7b0-42f8-8a5d-473afb719b7c-agent-certs\") pod \"konnectivity-agent-jdpnj\" (UID: \"0717052e-a7b0-42f8-8a5d-473afb719b7c\") " pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.640293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.640345    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-run-netns\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.640373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-multus-daemon-config\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.640399    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-device-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.640479    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-run-ovn-kubernetes\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.640559    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-cni-binary-copy\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.640691    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.640812    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-host-slash\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.642407 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.641500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-etc-tuned\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.643345 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.641830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-tmp\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.643345 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.642379    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-ovn-node-metrics-cert\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.645482 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.645450    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlvkh\" (UniqueName: \"kubernetes.io/projected/efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb-kube-api-access-dlvkh\") pod \"ovnkube-node-7d9sr\" (UID: \"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb\") " pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.646446 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.646363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56sqk\" (UniqueName: \"kubernetes.io/projected/958b9f76-31bd-4650-9982-96e485a636b9-kube-api-access-56sqk\") pod \"node-ca-p7ld9\" (UID: \"958b9f76-31bd-4650-9982-96e485a636b9\") " pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.648198 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.648107    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmxn\" (UniqueName: \"kubernetes.io/projected/0758e022-73b9-4f35-96e8-5d297cb56356-kube-api-access-vcmxn\") pod \"node-resolver-mtcnq\" (UID: \"0758e022-73b9-4f35-96e8-5d297cb56356\") " pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.648988 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.648957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mzdn\" (UniqueName: \"kubernetes.io/projected/1e4f950d-700a-43f2-a1fc-e50b3d9a8def-kube-api-access-5mzdn\") pod \"tuned-srjtq\" (UID: \"1e4f950d-700a-43f2-a1fc-e50b3d9a8def\") " pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.649713 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.649337    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z2rk\" (UniqueName: \"kubernetes.io/projected/f1861f9a-f8b9-491d-a70e-3fa4079d3e3a-kube-api-access-7z2rk\") pod \"multus-h4dcs\" (UID: \"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a\") " pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:04.649713 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.649668    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpd2s\" (UniqueName: \"kubernetes.io/projected/7ae04bb0-b799-4d93-81a7-ceffcafae9ac-kube-api-access-fpd2s\") pod \"aws-ebs-csi-driver-node-2khfp\" (UID: \"7ae04bb0-b799-4d93-81a7-ceffcafae9ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.681756 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.681682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal" event={"ID":"70d74643bae6540b1cf9e89d4caeb41c","Type":"ContainerStarted","Data":"6a8df8862b3a8622b89ba16f715f33abbaea88b2d258498a81efb45b44ecca67"}
Jul 18 03:50:04.683051 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.683012    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal" event={"ID":"ac85b0e2c258f1bb28fc0a607b6ac4d7","Type":"ContainerStarted","Data":"1f751381c4e8e39ea37d5d3d0d4e2c7779de2b852955da26892f15a1cd0e707c"}
Jul 18 03:50:04.703393 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.703359    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 03:50:04.721302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.721263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q922s"
Jul 18 03:50:04.731080 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.731048    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tnp6s"
Jul 18 03:50:04.741419 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.741384    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:04.749348 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.749317    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:04.758502 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.758467    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-srjtq"
Jul 18 03:50:04.768520 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.768488    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp"
Jul 18 03:50:04.778769 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.778734    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mtcnq"
Jul 18 03:50:04.787809 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.787785    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p7ld9"
Jul 18 03:50:04.796902 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:04.796873    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h4dcs"
Jul 18 03:50:05.040664 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:05.040562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:05.040664 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:05.040621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:05.040901 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.040765    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:05.040901 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.040772    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:05.040901 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.040838    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret podName:a61c4a15-f6f1-4663-a64c-85f4cd9465d9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:06.040815432 +0000 UTC m=+3.937000624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret") pod "global-pull-secret-syncer-bl8ng" (UID: "a61c4a15-f6f1-4663-a64c-85f4cd9465d9") : object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:05.040901 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.040858    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:50:06.040848997 +0000 UTC m=+3.937034169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:05.141642 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:05.141592    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:05.141819 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.141772    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 03:50:05.141819 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.141791    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 03:50:05.141819 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.141806    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h4c9k for pod openshift-network-diagnostics/network-check-target-d22vr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:05.141941 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.141875    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k podName:c92d63cc-b133-4038-a182-4ca3704232bc nodeName:}" failed. No retries permitted until 2026-07-18 03:50:06.141853814 +0000 UTC m=+4.038039011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4c9k" (UniqueName: "kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k") pod "network-check-target-d22vr" (UID: "c92d63cc-b133-4038-a182-4ca3704232bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:05.451973 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:05.451890    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 03:45:05 +0000 UTC" deadline="2028-02-22 04:16:23.023872463 +0000 UTC"
Jul 18 03:50:05.451973 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:05.451923    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14016h26m17.571953755s"
Jul 18 03:50:05.677493 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:05.677457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:05.677686 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:05.677455    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:05.677686 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.677586    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:05.677686 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:05.677650    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:05.792076 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:05.792041    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa3ca27_4ac9_48cc_aff4_4ec32a3f3ceb.slice/crio-0b4b79f81355676f2923e94360e747c995524bbf10582c6601b9daec552244fd WatchSource:0}: Error finding container 0b4b79f81355676f2923e94360e747c995524bbf10582c6601b9daec552244fd: Status 404 returned error can't find the container with id 0b4b79f81355676f2923e94360e747c995524bbf10582c6601b9daec552244fd
Jul 18 03:50:05.793495 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:05.793467    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958b9f76_31bd_4650_9982_96e485a636b9.slice/crio-7f831ec2f68ee49cc40ccc7afacb6197e3deec0a5f95580827eb59d081a5d734 WatchSource:0}: Error finding container 7f831ec2f68ee49cc40ccc7afacb6197e3deec0a5f95580827eb59d081a5d734: Status 404 returned error can't find the container with id 7f831ec2f68ee49cc40ccc7afacb6197e3deec0a5f95580827eb59d081a5d734
Jul 18 03:50:05.795038 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:05.794536    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efa1cd9_f09e_4141_9316_ab2a3d47b404.slice/crio-f9ed1a0285f4c01e61a95bcdfdaa48f44e69478668eac2cc144d457e3b1f9e47 WatchSource:0}: Error finding container f9ed1a0285f4c01e61a95bcdfdaa48f44e69478668eac2cc144d457e3b1f9e47: Status 404 returned error can't find the container with id f9ed1a0285f4c01e61a95bcdfdaa48f44e69478668eac2cc144d457e3b1f9e47
Jul 18 03:50:05.797956 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:05.796890    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4f950d_700a_43f2_a1fc_e50b3d9a8def.slice/crio-34ff6535d4e416435eb69664acd6fb7a43ac32a9f72bdb33b64f1aed37667a76 WatchSource:0}: Error finding container 34ff6535d4e416435eb69664acd6fb7a43ac32a9f72bdb33b64f1aed37667a76: Status 404 returned error can't find the container with id 34ff6535d4e416435eb69664acd6fb7a43ac32a9f72bdb33b64f1aed37667a76
Jul 18 03:50:05.799795 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:05.799747    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0758e022_73b9_4f35_96e8_5d297cb56356.slice/crio-a2938d8d05408a12964bf01633d6ecf00674eb8c2a3e4ec848384e17b54c2565 WatchSource:0}: Error finding container a2938d8d05408a12964bf01633d6ecf00674eb8c2a3e4ec848384e17b54c2565: Status 404 returned error can't find the container with id a2938d8d05408a12964bf01633d6ecf00674eb8c2a3e4ec848384e17b54c2565
Jul 18 03:50:05.801335 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:05.801131    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae04bb0_b799_4d93_81a7_ceffcafae9ac.slice/crio-54ea50968fee2d48c9a0e5359e42a55c336176900580b5f03da24a06b6f370a5 WatchSource:0}: Error finding container 54ea50968fee2d48c9a0e5359e42a55c336176900580b5f03da24a06b6f370a5: Status 404 returned error can't find the container with id 54ea50968fee2d48c9a0e5359e42a55c336176900580b5f03da24a06b6f370a5
Jul 18 03:50:05.802111 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:05.801826    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1861f9a_f8b9_491d_a70e_3fa4079d3e3a.slice/crio-6aac168b3ce232b8f8f999b5e6aed4572a484dedc9306d2cde9480cce163ea74 WatchSource:0}: Error finding container 6aac168b3ce232b8f8f999b5e6aed4572a484dedc9306d2cde9480cce163ea74: Status 404 returned error can't find the container with id 6aac168b3ce232b8f8f999b5e6aed4572a484dedc9306d2cde9480cce163ea74
Jul 18 03:50:05.803880 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:05.803857    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3991d8_3ae2_49e2_af88_6c5fc43b4e37.slice/crio-4b5a00c00714d8f5884e8f64a4c29118a539f0864906fa0932758aab0a8b514d WatchSource:0}: Error finding container 4b5a00c00714d8f5884e8f64a4c29118a539f0864906fa0932758aab0a8b514d: Status 404 returned error can't find the container with id 4b5a00c00714d8f5884e8f64a4c29118a539f0864906fa0932758aab0a8b514d
Jul 18 03:50:05.887270 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:05.887240    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 03:50:06.048889 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.048847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:06.049074 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.048919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:06.049074 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:06.049010    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:06.049206 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:06.049089    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret podName:a61c4a15-f6f1-4663-a64c-85f4cd9465d9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:08.049068746 +0000 UTC m=+5.945253940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret") pod "global-pull-secret-syncer-bl8ng" (UID: "a61c4a15-f6f1-4663-a64c-85f4cd9465d9") : object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:06.049206 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:06.049014    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:06.049206 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:06.049161    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:50:08.049145666 +0000 UTC m=+5.945330840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:06.150142 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.150096    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:06.150343 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:06.150311    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 03:50:06.150343 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:06.150336    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 03:50:06.150448 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:06.150351    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h4c9k for pod openshift-network-diagnostics/network-check-target-d22vr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:06.150448 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:06.150426    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k podName:c92d63cc-b133-4038-a182-4ca3704232bc nodeName:}" failed. No retries permitted until 2026-07-18 03:50:08.150404415 +0000 UTC m=+6.046589601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4c9k" (UniqueName: "kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k") pod "network-check-target-d22vr" (UID: "c92d63cc-b133-4038-a182-4ca3704232bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:06.453515 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.453388    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 03:45:05 +0000 UTC" deadline="2027-12-17 02:52:25.38256785 +0000 UTC"
Jul 18 03:50:06.453515 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.453457    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12407h2m18.929115639s"
Jul 18 03:50:06.680084 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.680048    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:06.680298 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:06.680197    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:06.707067 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.706229    2559 generic.go:356] "Generic (PLEG): container finished" podID="70d74643bae6540b1cf9e89d4caeb41c" containerID="19fdf7d802bbd8d4e9325daa236dc911f448c627b4691da38c04ec1b318a2a59" exitCode=0
Jul 18 03:50:06.707067 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.706335    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal" event={"ID":"70d74643bae6540b1cf9e89d4caeb41c","Type":"ContainerDied","Data":"19fdf7d802bbd8d4e9325daa236dc911f448c627b4691da38c04ec1b318a2a59"}
Jul 18 03:50:06.725972 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.725914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal" event={"ID":"ac85b0e2c258f1bb28fc0a607b6ac4d7","Type":"ContainerStarted","Data":"533700b85db6dea9ed4215dbffa435ee671d13dc8bc7d749b2355b9a0d3dfe4d"}
Jul 18 03:50:06.733854 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.733811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jdpnj" event={"ID":"0717052e-a7b0-42f8-8a5d-473afb719b7c","Type":"ContainerStarted","Data":"3f70ba501bfd09b21c33a3fa785f7e1da50890e94635df30da4b1060972b8c56"}
Jul 18 03:50:06.737368 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.737327    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q922s" event={"ID":"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37","Type":"ContainerStarted","Data":"4b5a00c00714d8f5884e8f64a4c29118a539f0864906fa0932758aab0a8b514d"}
Jul 18 03:50:06.739235 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.739199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h4dcs" event={"ID":"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a","Type":"ContainerStarted","Data":"6aac168b3ce232b8f8f999b5e6aed4572a484dedc9306d2cde9480cce163ea74"}
Jul 18 03:50:06.755333 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.755298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp" event={"ID":"7ae04bb0-b799-4d93-81a7-ceffcafae9ac","Type":"ContainerStarted","Data":"54ea50968fee2d48c9a0e5359e42a55c336176900580b5f03da24a06b6f370a5"}
Jul 18 03:50:06.764321 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.764283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-srjtq" event={"ID":"1e4f950d-700a-43f2-a1fc-e50b3d9a8def","Type":"ContainerStarted","Data":"34ff6535d4e416435eb69664acd6fb7a43ac32a9f72bdb33b64f1aed37667a76"}
Jul 18 03:50:06.785825 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.785708    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnp6s" event={"ID":"8efa1cd9-f09e-4141-9316-ab2a3d47b404","Type":"ContainerStarted","Data":"f9ed1a0285f4c01e61a95bcdfdaa48f44e69478668eac2cc144d457e3b1f9e47"}
Jul 18 03:50:06.803877 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.803837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mtcnq" event={"ID":"0758e022-73b9-4f35-96e8-5d297cb56356","Type":"ContainerStarted","Data":"a2938d8d05408a12964bf01633d6ecf00674eb8c2a3e4ec848384e17b54c2565"}
Jul 18 03:50:06.816843 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.816799    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p7ld9" event={"ID":"958b9f76-31bd-4650-9982-96e485a636b9","Type":"ContainerStarted","Data":"7f831ec2f68ee49cc40ccc7afacb6197e3deec0a5f95580827eb59d081a5d734"}
Jul 18 03:50:06.826321 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:06.826279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" event={"ID":"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb","Type":"ContainerStarted","Data":"0b4b79f81355676f2923e94360e747c995524bbf10582c6601b9daec552244fd"}
Jul 18 03:50:07.677630 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:07.677591    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:07.678207 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:07.677764    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:07.678207 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:07.678197    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:07.678367 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:07.678299    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:07.841073 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:07.840939    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal" event={"ID":"70d74643bae6540b1cf9e89d4caeb41c","Type":"ContainerStarted","Data":"b2ebb4b32a94f93fa23b1d2d82b013f9b1fde7cc6c669196c1c08775eea13ad1"}
Jul 18 03:50:07.857667 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:07.855685    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-148.ec2.internal" podStartSLOduration=3.855640985 podStartE2EDuration="3.855640985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:06.743119466 +0000 UTC m=+4.639304661" watchObservedRunningTime="2026-07-18 03:50:07.855640985 +0000 UTC m=+5.751826176"
Jul 18 03:50:08.070796 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:08.069937    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:08.070796 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:08.070011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:08.070796 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:08.070165    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:08.070796 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:08.070232    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret podName:a61c4a15-f6f1-4663-a64c-85f4cd9465d9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:12.070212633 +0000 UTC m=+9.966397825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret") pod "global-pull-secret-syncer-bl8ng" (UID: "a61c4a15-f6f1-4663-a64c-85f4cd9465d9") : object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:08.070796 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:08.070692    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:08.070796 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:08.070762    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:50:12.070745321 +0000 UTC m=+9.966930495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:08.172572 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:08.171682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:08.172572 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:08.171991    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 03:50:08.172572 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:08.172021    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 03:50:08.172572 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:08.172044    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h4c9k for pod openshift-network-diagnostics/network-check-target-d22vr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:08.172572 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:08.172109    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k podName:c92d63cc-b133-4038-a182-4ca3704232bc nodeName:}" failed. No retries permitted until 2026-07-18 03:50:12.172090175 +0000 UTC m=+10.068275350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4c9k" (UniqueName: "kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k") pod "network-check-target-d22vr" (UID: "c92d63cc-b133-4038-a182-4ca3704232bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:08.679784 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:08.679227    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:08.679784 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:08.679372    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:09.677714 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:09.677132    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:09.677714 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:09.677132    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:09.677714 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:09.677301    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:09.677714 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:09.677342    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:10.677624 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:10.677026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:10.677624 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:10.677194    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:11.677673 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:11.677546    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:11.678185 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:11.677728    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:11.678185 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:11.677765    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:11.678185 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:11.677974    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:12.108844 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:12.108519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:12.108844 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:12.108602    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:12.108844 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:12.108768    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:12.108844 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:12.108837    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:50:20.108817528 +0000 UTC m=+18.005002714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:12.109205 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:12.108768    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:12.109276 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:12.109242    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret podName:a61c4a15-f6f1-4663-a64c-85f4cd9465d9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:20.10921517 +0000 UTC m=+18.005400347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret") pod "global-pull-secret-syncer-bl8ng" (UID: "a61c4a15-f6f1-4663-a64c-85f4cd9465d9") : object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:12.209667 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:12.209623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:12.209885 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:12.209836    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 03:50:12.209885 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:12.209870    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 03:50:12.209885 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:12.209888    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h4c9k for pod openshift-network-diagnostics/network-check-target-d22vr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:12.210172 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:12.209962    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k podName:c92d63cc-b133-4038-a182-4ca3704232bc nodeName:}" failed. No retries permitted until 2026-07-18 03:50:20.209940651 +0000 UTC m=+18.106125829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4c9k" (UniqueName: "kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k") pod "network-check-target-d22vr" (UID: "c92d63cc-b133-4038-a182-4ca3704232bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:12.677794 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:12.677750    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:12.678326 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:12.677884    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:13.677277 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:13.677236    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:13.677487 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:13.677403    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:13.677895 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:13.677874    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:13.678247 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:13.677982    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:14.677508 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:14.677247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:14.677508 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:14.677386    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:15.677183 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:15.677145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:15.677183 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:15.677166    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:15.677670 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:15.677286    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:15.677670 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:15.677416    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:16.676945 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:16.676911    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:16.677129 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:16.677029    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:17.676761 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:17.676723    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:17.677226 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:17.676724    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:17.677226 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:17.676850    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:17.677226 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:17.676941    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:18.677500 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:18.677463    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:18.678008 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:18.677586    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:19.677202 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:19.677159    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:19.677435 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:19.677160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:19.677435 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:19.677288    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:19.677435 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:19.677394    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:20.176278 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:20.176186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:20.176278 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:20.176245    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:20.176769 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:20.176354    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:20.176769 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:20.176427    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:50:36.176411229 +0000 UTC m=+34.072596403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:20.176769 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:20.176360    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:20.176769 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:20.176508    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret podName:a61c4a15-f6f1-4663-a64c-85f4cd9465d9 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:36.176492035 +0000 UTC m=+34.072677221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret") pod "global-pull-secret-syncer-bl8ng" (UID: "a61c4a15-f6f1-4663-a64c-85f4cd9465d9") : object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:20.277096 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:20.277041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:20.277271 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:20.277214    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 03:50:20.277271 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:20.277244    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 03:50:20.277271 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:20.277260    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h4c9k for pod openshift-network-diagnostics/network-check-target-d22vr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:20.277392 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:20.277323    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k podName:c92d63cc-b133-4038-a182-4ca3704232bc nodeName:}" failed. No retries permitted until 2026-07-18 03:50:36.277305708 +0000 UTC m=+34.173490898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4c9k" (UniqueName: "kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k") pod "network-check-target-d22vr" (UID: "c92d63cc-b133-4038-a182-4ca3704232bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:20.677600 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:20.677565    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:20.677771 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:20.677713    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:21.677536 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:21.677494    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:21.677536 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:21.677537    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:21.678018 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:21.677663    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:21.678018 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:21.677775    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:22.678219 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:22.678186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:22.678639 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:22.678293    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:23.677082 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:23.677047    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:23.677254 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:23.677155    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:23.677254 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:23.677212    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:23.677363 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:23.677342    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:24.677602 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:24.677566    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:24.678003 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:24.677693    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:25.677811 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.677467    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:25.678503 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.677476    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:25.678503 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:25.677919    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:25.678503 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:25.677972    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:25.883782 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.883744    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jdpnj" event={"ID":"0717052e-a7b0-42f8-8a5d-473afb719b7c","Type":"ContainerStarted","Data":"fa6457db5de2cc258c05d5ebc59560ec9cea107da0a1ccdaecda39b3d9960cf4"}
Jul 18 03:50:25.885228 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.885191    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h4dcs" event={"ID":"f1861f9a-f8b9-491d-a70e-3fa4079d3e3a","Type":"ContainerStarted","Data":"4ebdbe5e91c1e3bddb96ef9fe0b92d5179eed0a92f9a2aa61f48f697eeabc81a"}
Jul 18 03:50:25.886709 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.886680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp" event={"ID":"7ae04bb0-b799-4d93-81a7-ceffcafae9ac","Type":"ContainerStarted","Data":"8d368b35dbc8351b4ee9206211f94f0d9a94063b98830f635dd7d03c9c215a2f"}
Jul 18 03:50:25.888189 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.888162    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-srjtq" event={"ID":"1e4f950d-700a-43f2-a1fc-e50b3d9a8def","Type":"ContainerStarted","Data":"220f7945433b871e26b7e7aaf0b79fdeda0da31b3ad627bcdcf8fea933fb98b9"}
Jul 18 03:50:25.889751 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.889730    2559 generic.go:356] "Generic (PLEG): container finished" podID="8efa1cd9-f09e-4141-9316-ab2a3d47b404" containerID="8b723d8693703691acda0638bb724b0ff7cd3c06c6fc61a7de744482f4844f10" exitCode=0
Jul 18 03:50:25.889849 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.889792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnp6s" event={"ID":"8efa1cd9-f09e-4141-9316-ab2a3d47b404","Type":"ContainerDied","Data":"8b723d8693703691acda0638bb724b0ff7cd3c06c6fc61a7de744482f4844f10"}
Jul 18 03:50:25.891266 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.891242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mtcnq" event={"ID":"0758e022-73b9-4f35-96e8-5d297cb56356","Type":"ContainerStarted","Data":"7fd771c18ef8a906ee84135397dfcabb96a30e0c2bc3b0f276827064d16cb4fe"}
Jul 18 03:50:25.892882 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.892850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p7ld9" event={"ID":"958b9f76-31bd-4650-9982-96e485a636b9","Type":"ContainerStarted","Data":"62561bf50b4686f94288095430731272c527108bfa638e92f48cc52fdc63a0e6"}
Jul 18 03:50:25.895843 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.895818    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" event={"ID":"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb","Type":"ContainerStarted","Data":"124995c633052d587dd33797f62eb149cfc30c27b88b13d4284c6e533b1bb162"}
Jul 18 03:50:25.895954 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.895899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" event={"ID":"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb","Type":"ContainerStarted","Data":"e4a1ea94c41e3b9649d42f7b7f06fe20d4266e91a19f8dc1ac3d6e9fe9f1bd92"}
Jul 18 03:50:25.896010 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.895983    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" event={"ID":"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb","Type":"ContainerStarted","Data":"01484e54e3b70483f8601b8af16dfc8a89936f72baae56c28a3702bb45e7f1f4"}
Jul 18 03:50:25.896060 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.896032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" event={"ID":"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb","Type":"ContainerStarted","Data":"a2a557ffd30b0403b0fd1a0c57245854180e9b932ece02152dc07e5f439b238b"}
Jul 18 03:50:25.896110 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.896077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" event={"ID":"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb","Type":"ContainerStarted","Data":"d1dbde922f5d1d59d6eca28a82e4ff6daa05ada7876dc424680d25d3030ffc8e"}
Jul 18 03:50:25.896165 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.896122    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" event={"ID":"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb","Type":"ContainerStarted","Data":"556b80cf832741d957ff86376493f82797bb38b4670b959e66398bcb2f72ef98"}
Jul 18 03:50:25.896753 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.896712    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jdpnj" podStartSLOduration=7.879049944 podStartE2EDuration="22.896697056s" totalImagesPullingTime="15.017647112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:25.896390678 +0000 UTC m=+23.792575872" watchObservedRunningTime="2026-07-18 03:50:25.896697056 +0000 UTC m=+23.792882249"
Jul 18 03:50:25.897111 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.897088    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-148.ec2.internal" podStartSLOduration=21.897081828 podStartE2EDuration="21.897081828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:07.857275489 +0000 UTC m=+5.753460684" watchObservedRunningTime="2026-07-18 03:50:25.897081828 +0000 UTC m=+23.793267020"
Jul 18 03:50:25.910299 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.910254    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-srjtq" podStartSLOduration=3.663875392 podStartE2EDuration="22.910238723s" totalImagesPullingTime="19.246363331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:25.909760293 +0000 UTC m=+23.805945485" watchObservedRunningTime="2026-07-18 03:50:25.910238723 +0000 UTC m=+23.806423919"
Jul 18 03:50:25.922255 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.922205    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mtcnq" podStartSLOduration=3.694755264 podStartE2EDuration="22.922185359s" totalImagesPullingTime="19.227430095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:25.922007909 +0000 UTC m=+23.818193120" watchObservedRunningTime="2026-07-18 03:50:25.922185359 +0000 UTC m=+23.818370549"
Jul 18 03:50:25.933906 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.933860    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p7ld9" podStartSLOduration=3.701567582 podStartE2EDuration="22.93384561s" totalImagesPullingTime="19.232278028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:25.933694384 +0000 UTC m=+23.829879601" watchObservedRunningTime="2026-07-18 03:50:25.93384561 +0000 UTC m=+23.830030800"
Jul 18 03:50:25.979325 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:25.979271    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h4dcs" podStartSLOduration=3.691300051 podStartE2EDuration="22.979252275s" totalImagesPullingTime="19.287952224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:25.978832113 +0000 UTC m=+23.875017295" watchObservedRunningTime="2026-07-18 03:50:25.979252275 +0000 UTC m=+23.875437468"
Jul 18 03:50:26.471591 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:26.471557    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 03:50:26.491218 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:26.491105    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T03:50:26.471583895Z","UUID":"d73f7ba8-1446-4f33-9354-d6cad01604b6","Handler":null,"Name":"","Endpoint":""}
Jul 18 03:50:26.492792 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:26.492770    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 03:50:26.492792 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:26.492807    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 03:50:26.677315 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:26.677196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:26.677570 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:26.677381    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:26.900456 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:26.900416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q922s" event={"ID":"7f3991d8-3ae2-49e2-af88-6c5fc43b4e37","Type":"ContainerStarted","Data":"dab55a19bf2a23afbea0675f10deb7e19d124cb35f4643f4e12b7fbe69edd3cf"}
Jul 18 03:50:26.903736 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:26.903698    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp" event={"ID":"7ae04bb0-b799-4d93-81a7-ceffcafae9ac","Type":"ContainerStarted","Data":"9f312977187f4258a071c9c4493d7e19ef4130451794905e90613112471dff1e"}
Jul 18 03:50:26.914157 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:26.914097    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q922s" podStartSLOduration=4.691282283 podStartE2EDuration="23.914075374s" totalImagesPullingTime="19.222793091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:26.91344566 +0000 UTC m=+24.809630873" watchObservedRunningTime="2026-07-18 03:50:26.914075374 +0000 UTC m=+24.810260569"
Jul 18 03:50:27.677701 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:27.677486    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:27.677973 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:27.677540    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:27.677973 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:27.677805    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:27.677973 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:27.677874    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:27.908630 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:27.908595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp" event={"ID":"7ae04bb0-b799-4d93-81a7-ceffcafae9ac","Type":"ContainerStarted","Data":"b9c21d2f5c3007c32d1a8606b5b9bbf1a002a1143f92bf59d3684d3dbec195a1"}
Jul 18 03:50:28.676936 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:28.676905    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:28.677189 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:28.677042    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:28.915708 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:28.915668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" event={"ID":"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb","Type":"ContainerStarted","Data":"6443cacc16104dc202ab3cb9ad7e5c015dd96849fe10d1b7499fcd3e829945d0"}
Jul 18 03:50:29.677929 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:29.677899    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:29.678124 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:29.677945    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:29.678363 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:29.678336    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:29.678495 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:29.678467    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:30.677797 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.677534    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:30.678536 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:30.677835    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:30.783255 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.783210    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:30.783827 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.783810    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:30.796535 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.796486    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2khfp" podStartSLOduration=6.498264901 podStartE2EDuration="27.796472911s" totalImagesPullingTime="21.29820801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:27.924351603 +0000 UTC m=+25.820536795" watchObservedRunningTime="2026-07-18 03:50:30.796472911 +0000 UTC m=+28.692658151"
Jul 18 03:50:30.923447 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.923410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" event={"ID":"efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb","Type":"ContainerStarted","Data":"dd9e190880448b601bb9049dff8bc088a020c404de1f412e68d6396fd5a9a7b4"}
Jul 18 03:50:30.923682 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.923629    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:30.925243 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.925220    2559 generic.go:356] "Generic (PLEG): container finished" podID="8efa1cd9-f09e-4141-9316-ab2a3d47b404" containerID="2d07795db905ba65bcd1d2d7f383fc03ea1c6ccc4ec6cf301c994cd313d7b08e" exitCode=0
Jul 18 03:50:30.925358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.925296    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnp6s" event={"ID":"8efa1cd9-f09e-4141-9316-ab2a3d47b404","Type":"ContainerDied","Data":"2d07795db905ba65bcd1d2d7f383fc03ea1c6ccc4ec6cf301c994cd313d7b08e"}
Jul 18 03:50:30.925500 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.925478    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:30.926015 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.925954    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jdpnj"
Jul 18 03:50:30.940981 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.940956    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:30.945900 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:30.945857    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr" podStartSLOduration=8.638446755 podStartE2EDuration="27.945841673s" totalImagesPullingTime="19.307394918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:30.944966785 +0000 UTC m=+28.841151975" watchObservedRunningTime="2026-07-18 03:50:30.945841673 +0000 UTC m=+28.842026863"
Jul 18 03:50:31.676922 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:31.676839    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:31.676922 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:31.676885    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:31.677267 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:31.676976    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:31.677267 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:31.677071    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:31.931298 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:31.931269    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:31.931711 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:31.931354    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:31.947058 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:31.946793    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:50:32.071960 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:32.071931    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bl8ng"]
Jul 18 03:50:32.072151 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:32.072040    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:32.072151 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:32.072118    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:32.075811 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:32.075779    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d22vr"]
Jul 18 03:50:32.075969 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:32.075918    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:32.076036 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:32.076015    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:32.076478 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:32.076458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-48dcs"]
Jul 18 03:50:32.076563 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:32.076548    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:32.076715 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:32.076693    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:32.934209 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:32.934173    2559 generic.go:356] "Generic (PLEG): container finished" podID="8efa1cd9-f09e-4141-9316-ab2a3d47b404" containerID="8469e205a81c28548cc7ab25dacc29d69276eca3980f3cb0f620452dd5d60de2" exitCode=0
Jul 18 03:50:32.934712 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:32.934258    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnp6s" event={"ID":"8efa1cd9-f09e-4141-9316-ab2a3d47b404","Type":"ContainerDied","Data":"8469e205a81c28548cc7ab25dacc29d69276eca3980f3cb0f620452dd5d60de2"}
Jul 18 03:50:33.677192 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:33.677160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:33.677372 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:33.677164    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:33.677372 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:33.677268    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:33.677372 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:33.677298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:33.677372 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:33.677353    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:33.677564 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:33.677417    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:34.943965 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:34.943930    2559 generic.go:356] "Generic (PLEG): container finished" podID="8efa1cd9-f09e-4141-9316-ab2a3d47b404" containerID="4c008ad5cac795f606ddad8faa08c4f98e7eaf48a7644665cbfb78b982ff60ab" exitCode=0
Jul 18 03:50:34.944677 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:34.943997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnp6s" event={"ID":"8efa1cd9-f09e-4141-9316-ab2a3d47b404","Type":"ContainerDied","Data":"4c008ad5cac795f606ddad8faa08c4f98e7eaf48a7644665cbfb78b982ff60ab"}
Jul 18 03:50:35.677406 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:35.677368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:35.677610 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:35.677368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:35.677610 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:35.677508    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:35.677610 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:35.677368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:35.677610 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:35.677569    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:35.677847 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:35.677682    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:36.196641 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:36.196607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:36.197117 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:36.196776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:36.197117 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:36.196776    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:36.197117 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:36.196827    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:36.197117 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:36.196852    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret podName:a61c4a15-f6f1-4663-a64c-85f4cd9465d9 nodeName:}" failed. No retries permitted until 2026-07-18 03:51:08.196832612 +0000 UTC m=+66.093017782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret") pod "global-pull-secret-syncer-bl8ng" (UID: "a61c4a15-f6f1-4663-a64c-85f4cd9465d9") : object "kube-system"/"original-pull-secret" not registered
Jul 18 03:50:36.197117 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:36.196895    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:51:08.196875139 +0000 UTC m=+66.093060312 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 03:50:36.297269 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:36.297233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:36.297496 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:36.297416    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 03:50:36.297496 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:36.297441    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 03:50:36.297496 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:36.297456    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h4c9k for pod openshift-network-diagnostics/network-check-target-d22vr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:36.297669 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:36.297523    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k podName:c92d63cc-b133-4038-a182-4ca3704232bc nodeName:}" failed. No retries permitted until 2026-07-18 03:51:08.297504968 +0000 UTC m=+66.193690137 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4c9k" (UniqueName: "kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k") pod "network-check-target-d22vr" (UID: "c92d63cc-b133-4038-a182-4ca3704232bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 03:50:37.677546 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:37.677491    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:37.677546 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:37.677533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:37.678060 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:37.677513    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:37.678060 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:37.677630    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:50:37.678060 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:37.677732    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d22vr" podUID="c92d63cc-b133-4038-a182-4ca3704232bc"
Jul 18 03:50:37.678060 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:37.677811    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bl8ng" podUID="a61c4a15-f6f1-4663-a64c-85f4cd9465d9"
Jul 18 03:50:38.921752 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.921679    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-148.ec2.internal" event="NodeReady"
Jul 18 03:50:38.922084 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.921791    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 03:50:38.961038 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.961008    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s6q77"]
Jul 18 03:50:38.963898 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.963874    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z79sn"]
Jul 18 03:50:38.964060 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.964028    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:38.965704 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.965678    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z79sn"
Jul 18 03:50:38.966101 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.966075    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rnqn\""
Jul 18 03:50:38.966225 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.966194    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 03:50:38.966225 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.966214    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 03:50:38.967807 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.967790    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 03:50:38.968165 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.967993    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nm4kf\""
Jul 18 03:50:38.968165 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.968026    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 03:50:38.968165 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.968082    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 03:50:38.974877 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.974843    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s6q77"]
Jul 18 03:50:38.975485 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:38.975463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z79sn"]
Jul 18 03:50:39.019601 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.019376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.019784 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.019624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/201aa012-979d-450c-9f8c-3bdc4ada48c3-cert\") pod \"ingress-canary-z79sn\" (UID: \"201aa012-979d-450c-9f8c-3bdc4ada48c3\") " pod="openshift-ingress-canary/ingress-canary-z79sn"
Jul 18 03:50:39.019784 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.019685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krn88\" (UniqueName: \"kubernetes.io/projected/201aa012-979d-450c-9f8c-3bdc4ada48c3-kube-api-access-krn88\") pod \"ingress-canary-z79sn\" (UID: \"201aa012-979d-450c-9f8c-3bdc4ada48c3\") " pod="openshift-ingress-canary/ingress-canary-z79sn"
Jul 18 03:50:39.019907 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.019812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e657418-e3de-471d-b1a6-26019a3da8fa-config-volume\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.019907 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.019840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58ct6\" (UniqueName: \"kubernetes.io/projected/9e657418-e3de-471d-b1a6-26019a3da8fa-kube-api-access-58ct6\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.019907 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.019880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e657418-e3de-471d-b1a6-26019a3da8fa-tmp-dir\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.120767 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.120733    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e657418-e3de-471d-b1a6-26019a3da8fa-tmp-dir\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.120767 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.120770    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.120982 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.120787    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/201aa012-979d-450c-9f8c-3bdc4ada48c3-cert\") pod \"ingress-canary-z79sn\" (UID: \"201aa012-979d-450c-9f8c-3bdc4ada48c3\") " pod="openshift-ingress-canary/ingress-canary-z79sn"
Jul 18 03:50:39.120982 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.120814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krn88\" (UniqueName: \"kubernetes.io/projected/201aa012-979d-450c-9f8c-3bdc4ada48c3-kube-api-access-krn88\") pod \"ingress-canary-z79sn\" (UID: \"201aa012-979d-450c-9f8c-3bdc4ada48c3\") " pod="openshift-ingress-canary/ingress-canary-z79sn"
Jul 18 03:50:39.120982 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:39.120900    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 03:50:39.120982 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:39.120965    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls podName:9e657418-e3de-471d-b1a6-26019a3da8fa nodeName:}" failed. No retries permitted until 2026-07-18 03:50:39.620946935 +0000 UTC m=+37.517132121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls") pod "dns-default-s6q77" (UID: "9e657418-e3de-471d-b1a6-26019a3da8fa") : secret "dns-default-metrics-tls" not found
Jul 18 03:50:39.120982 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.120904    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e657418-e3de-471d-b1a6-26019a3da8fa-config-volume\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.121220 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.121023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58ct6\" (UniqueName: \"kubernetes.io/projected/9e657418-e3de-471d-b1a6-26019a3da8fa-kube-api-access-58ct6\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.121220 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.121135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e657418-e3de-471d-b1a6-26019a3da8fa-tmp-dir\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.121405 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.121385    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e657418-e3de-471d-b1a6-26019a3da8fa-config-volume\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.125114 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.125089    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/201aa012-979d-450c-9f8c-3bdc4ada48c3-cert\") pod \"ingress-canary-z79sn\" (UID: \"201aa012-979d-450c-9f8c-3bdc4ada48c3\") " pod="openshift-ingress-canary/ingress-canary-z79sn"
Jul 18 03:50:39.137581 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.137550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58ct6\" (UniqueName: \"kubernetes.io/projected/9e657418-e3de-471d-b1a6-26019a3da8fa-kube-api-access-58ct6\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.137702 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.137628    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krn88\" (UniqueName: \"kubernetes.io/projected/201aa012-979d-450c-9f8c-3bdc4ada48c3-kube-api-access-krn88\") pod \"ingress-canary-z79sn\" (UID: \"201aa012-979d-450c-9f8c-3bdc4ada48c3\") " pod="openshift-ingress-canary/ingress-canary-z79sn"
Jul 18 03:50:39.296113 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.296061    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z79sn"
Jul 18 03:50:39.427244 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.427216    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z79sn"]
Jul 18 03:50:39.431168 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:50:39.431144    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201aa012_979d_450c_9f8c_3bdc4ada48c3.slice/crio-aecf7ff7f3632a4a015f9ae968bf987d6b9d87289f504ac7b2ab26499fcd02b2 WatchSource:0}: Error finding container aecf7ff7f3632a4a015f9ae968bf987d6b9d87289f504ac7b2ab26499fcd02b2: Status 404 returned error can't find the container with id aecf7ff7f3632a4a015f9ae968bf987d6b9d87289f504ac7b2ab26499fcd02b2
Jul 18 03:50:39.625378 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.625281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:39.625534 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:39.625409    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 03:50:39.625534 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:39.625477    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls podName:9e657418-e3de-471d-b1a6-26019a3da8fa nodeName:}" failed. No retries permitted until 2026-07-18 03:50:40.62545955 +0000 UTC m=+38.521644718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls") pod "dns-default-s6q77" (UID: "9e657418-e3de-471d-b1a6-26019a3da8fa") : secret "dns-default-metrics-tls" not found
Jul 18 03:50:39.677298 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.677270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:50:39.677382 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.677270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:50:39.677496 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.677270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:50:39.679666 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.679630    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 03:50:39.679813 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.679685    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 03:50:39.679813 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.679761    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g4mng\""
Jul 18 03:50:39.679813 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.679798    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 03:50:39.680035 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.680018    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 03:50:39.680172 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.680158    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mc9fd\""
Jul 18 03:50:39.960212 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.960116    2559 generic.go:356] "Generic (PLEG): container finished" podID="8efa1cd9-f09e-4141-9316-ab2a3d47b404" containerID="908c1dae568f3b93e0ecb5a6280f3d0714143b9ba5dbd05687c8f3f3297a9bb3" exitCode=0
Jul 18 03:50:39.960691 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.960201    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnp6s" event={"ID":"8efa1cd9-f09e-4141-9316-ab2a3d47b404","Type":"ContainerDied","Data":"908c1dae568f3b93e0ecb5a6280f3d0714143b9ba5dbd05687c8f3f3297a9bb3"}
Jul 18 03:50:39.961558 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:39.961444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z79sn" event={"ID":"201aa012-979d-450c-9f8c-3bdc4ada48c3","Type":"ContainerStarted","Data":"aecf7ff7f3632a4a015f9ae968bf987d6b9d87289f504ac7b2ab26499fcd02b2"}
Jul 18 03:50:40.632485 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:40.632257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:40.632685 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:40.632404    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 03:50:40.632685 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:40.632616    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls podName:9e657418-e3de-471d-b1a6-26019a3da8fa nodeName:}" failed. No retries permitted until 2026-07-18 03:50:42.632600365 +0000 UTC m=+40.528785534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls") pod "dns-default-s6q77" (UID: "9e657418-e3de-471d-b1a6-26019a3da8fa") : secret "dns-default-metrics-tls" not found
Jul 18 03:50:40.967177 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:40.967143    2559 generic.go:356] "Generic (PLEG): container finished" podID="8efa1cd9-f09e-4141-9316-ab2a3d47b404" containerID="ee2eae349c3c55de41a563402c6a2ea5b598777197c74334ce1e833c1f091f1e" exitCode=0
Jul 18 03:50:40.967692 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:40.967204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnp6s" event={"ID":"8efa1cd9-f09e-4141-9316-ab2a3d47b404","Type":"ContainerDied","Data":"ee2eae349c3c55de41a563402c6a2ea5b598777197c74334ce1e833c1f091f1e"}
Jul 18 03:50:41.971178 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:41.971138    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z79sn" event={"ID":"201aa012-979d-450c-9f8c-3bdc4ada48c3","Type":"ContainerStarted","Data":"0a97f10047a493e0ab4c47c793683cd7534216479c4c850b8204884d98e69e8e"}
Jul 18 03:50:41.974309 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:41.974279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnp6s" event={"ID":"8efa1cd9-f09e-4141-9316-ab2a3d47b404","Type":"ContainerStarted","Data":"496ec42acc9222ce4a653d9f79c6270cde6da5c77b7f80cb8ba9f9e71a83c7c0"}
Jul 18 03:50:41.984552 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:41.984511    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z79sn" podStartSLOduration=1.871987769 podStartE2EDuration="3.984495992s" totalImagesPullingTime="2.112508223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:41.983860978 +0000 UTC m=+39.880046168" watchObservedRunningTime="2026-07-18 03:50:41.984495992 +0000 UTC m=+39.880681182"
Jul 18 03:50:42.001990 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:42.001942    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tnp6s" podStartSLOduration=9.833249885 podStartE2EDuration="39.001924783s" totalImagesPullingTime="29.168674898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:42.001892157 +0000 UTC m=+39.898077359" watchObservedRunningTime="2026-07-18 03:50:42.001924783 +0000 UTC m=+39.898109975"
Jul 18 03:50:42.647711 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:42.647662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:42.647885 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:42.647800    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 03:50:42.647885 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:42.647867    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls podName:9e657418-e3de-471d-b1a6-26019a3da8fa nodeName:}" failed. No retries permitted until 2026-07-18 03:50:46.647850853 +0000 UTC m=+44.544036026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls") pod "dns-default-s6q77" (UID: "9e657418-e3de-471d-b1a6-26019a3da8fa") : secret "dns-default-metrics-tls" not found
Jul 18 03:50:46.678154 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:46.678107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:46.678797 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:46.678259    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 03:50:46.678797 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:46.678336    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls podName:9e657418-e3de-471d-b1a6-26019a3da8fa nodeName:}" failed. No retries permitted until 2026-07-18 03:50:54.678318859 +0000 UTC m=+52.574504071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls") pod "dns-default-s6q77" (UID: "9e657418-e3de-471d-b1a6-26019a3da8fa") : secret "dns-default-metrics-tls" not found
Jul 18 03:50:54.729665 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:50:54.729620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:50:54.730137 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:54.729767    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 03:50:54.730137 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:50:54.729833    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls podName:9e657418-e3de-471d-b1a6-26019a3da8fa nodeName:}" failed. No retries permitted until 2026-07-18 03:51:10.72981666 +0000 UTC m=+68.626001828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls") pod "dns-default-s6q77" (UID: "9e657418-e3de-471d-b1a6-26019a3da8fa") : secret "dns-default-metrics-tls" not found
Jul 18 03:51:03.958739 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:03.958706    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7d9sr"
Jul 18 03:51:08.230428 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.228130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:51:08.230428 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.228252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:51:08.230985 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.230844    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 03:51:08.230985 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.230913    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 03:51:08.238570 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:51:08.238544    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 18 03:51:08.238661 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:51:08.238629    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:52:12.23861179 +0000 UTC m=+130.134796964 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : secret "metrics-daemon-secret" not found
Jul 18 03:51:08.241930 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.241904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a61c4a15-f6f1-4663-a64c-85f4cd9465d9-original-pull-secret\") pod \"global-pull-secret-syncer-bl8ng\" (UID: \"a61c4a15-f6f1-4663-a64c-85f4cd9465d9\") " pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:51:08.329345 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.329307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:51:08.331478 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.331458    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 03:51:08.341841 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.341814    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 03:51:08.352844 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.352813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4c9k\" (UniqueName: \"kubernetes.io/projected/c92d63cc-b133-4038-a182-4ca3704232bc-kube-api-access-h4c9k\") pod \"network-check-target-d22vr\" (UID: \"c92d63cc-b133-4038-a182-4ca3704232bc\") " pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:51:08.493638 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.493528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bl8ng"
Jul 18 03:51:08.499502 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.499483    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mc9fd\""
Jul 18 03:51:08.508124 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.508101    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:51:08.639339 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.639305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bl8ng"]
Jul 18 03:51:08.642959 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:51:08.642931    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61c4a15_f6f1_4663_a64c_85f4cd9465d9.slice/crio-894e0446b2f67769387fc40da86fc2d37d6fccf97a11d551d0c0e393a2872026 WatchSource:0}: Error finding container 894e0446b2f67769387fc40da86fc2d37d6fccf97a11d551d0c0e393a2872026: Status 404 returned error can't find the container with id 894e0446b2f67769387fc40da86fc2d37d6fccf97a11d551d0c0e393a2872026
Jul 18 03:51:08.659432 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:08.659405    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d22vr"]
Jul 18 03:51:08.662198 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:51:08.662176    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92d63cc_b133_4038_a182_4ca3704232bc.slice/crio-afa68ab268d40070a5181bc35a8045875f69137217e0c70a58d333b1aa868db0 WatchSource:0}: Error finding container afa68ab268d40070a5181bc35a8045875f69137217e0c70a58d333b1aa868db0: Status 404 returned error can't find the container with id afa68ab268d40070a5181bc35a8045875f69137217e0c70a58d333b1aa868db0
Jul 18 03:51:09.038327 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:09.038281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d22vr" event={"ID":"c92d63cc-b133-4038-a182-4ca3704232bc","Type":"ContainerStarted","Data":"afa68ab268d40070a5181bc35a8045875f69137217e0c70a58d333b1aa868db0"}
Jul 18 03:51:09.039857 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:09.039825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bl8ng" event={"ID":"a61c4a15-f6f1-4663-a64c-85f4cd9465d9","Type":"ContainerStarted","Data":"894e0446b2f67769387fc40da86fc2d37d6fccf97a11d551d0c0e393a2872026"}
Jul 18 03:51:10.746493 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:10.746436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:51:10.746983 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:51:10.746600    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 03:51:10.746983 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:51:10.746708    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls podName:9e657418-e3de-471d-b1a6-26019a3da8fa nodeName:}" failed. No retries permitted until 2026-07-18 03:51:42.746677814 +0000 UTC m=+100.642863003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls") pod "dns-default-s6q77" (UID: "9e657418-e3de-471d-b1a6-26019a3da8fa") : secret "dns-default-metrics-tls" not found
Jul 18 03:51:14.054843 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:14.054804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d22vr" event={"ID":"c92d63cc-b133-4038-a182-4ca3704232bc","Type":"ContainerStarted","Data":"2be5960da312786218d102ae9e2d4edfa8277555c6576e9f3c087ee442e86570"}
Jul 18 03:51:14.055264 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:14.054909    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:51:14.056156 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:14.056134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bl8ng" event={"ID":"a61c4a15-f6f1-4663-a64c-85f4cd9465d9","Type":"ContainerStarted","Data":"82dd1fab3e77659ee03bf70d02537b9d2696ce146c4af22230843f0ce09daefd"}
Jul 18 03:51:14.070374 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:14.070319    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d22vr" podStartSLOduration=66.494156945 podStartE2EDuration="1m11.070301506s" totalImagesPullingTime="4.576144561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:51:14.068924839 +0000 UTC m=+71.965110029" watchObservedRunningTime="2026-07-18 03:51:14.070301506 +0000 UTC m=+71.966486698"
Jul 18 03:51:14.081003 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:14.080945    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bl8ng" podStartSLOduration=66.474708451 podStartE2EDuration="1m11.080928612s" totalImagesPullingTime="4.606220161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:51:14.080552177 +0000 UTC m=+71.976737369" watchObservedRunningTime="2026-07-18 03:51:14.080928612 +0000 UTC m=+71.977113882"
Jul 18 03:51:42.758583 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:42.758531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:51:42.759035 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:51:42.758703    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 03:51:42.759035 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:51:42.758805    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls podName:9e657418-e3de-471d-b1a6-26019a3da8fa nodeName:}" failed. No retries permitted until 2026-07-18 03:52:46.758790353 +0000 UTC m=+164.654975522 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls") pod "dns-default-s6q77" (UID: "9e657418-e3de-471d-b1a6-26019a3da8fa") : secret "dns-default-metrics-tls" not found
Jul 18 03:51:45.060838 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:45.060808    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d22vr"
Jul 18 03:51:52.644934 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.644893    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"]
Jul 18 03:51:52.646492 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.646474    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"
Jul 18 03:51:52.648501 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.648480    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 18 03:51:52.649268 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.649250    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 18 03:51:52.649360 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.649296    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9w7pn\""
Jul 18 03:51:52.649432 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.649370    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 18 03:51:52.649432 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.649385    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 18 03:51:52.656772 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.656744    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"]
Jul 18 03:51:52.693499 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.693471    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"]
Jul 18 03:51:52.695316 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.695299    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.697282 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.697257    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 18 03:51:52.697433 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.697414    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 18 03:51:52.697551 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.697534    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 18 03:51:52.697608 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.697544    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 18 03:51:52.704840 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.704815    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"]
Jul 18 03:51:52.725610 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.725574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bff4z\" (UniqueName: \"kubernetes.io/projected/e3bc23e2-03d7-4f9d-995c-0720aace9643-kube-api-access-bff4z\") pod \"managed-serviceaccount-addon-agent-7c64c8f96d-lggkx\" (UID: \"e3bc23e2-03d7-4f9d-995c-0720aace9643\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"
Jul 18 03:51:52.725798 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.725642    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3bc23e2-03d7-4f9d-995c-0720aace9643-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c64c8f96d-lggkx\" (UID: \"e3bc23e2-03d7-4f9d-995c-0720aace9643\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"
Jul 18 03:51:52.826020 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.825985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e95d1262-2304-41c7-aa47-603257961990-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.826115 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.826031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-hub\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.826115 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.826050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.826191 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.826110    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bff4z\" (UniqueName: \"kubernetes.io/projected/e3bc23e2-03d7-4f9d-995c-0720aace9643-kube-api-access-bff4z\") pod \"managed-serviceaccount-addon-agent-7c64c8f96d-lggkx\" (UID: \"e3bc23e2-03d7-4f9d-995c-0720aace9643\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"
Jul 18 03:51:52.826191 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.826156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-ca\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.826191 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.826175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prq4k\" (UniqueName: \"kubernetes.io/projected/e95d1262-2304-41c7-aa47-603257961990-kube-api-access-prq4k\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.826281 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.826224    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3bc23e2-03d7-4f9d-995c-0720aace9643-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c64c8f96d-lggkx\" (UID: \"e3bc23e2-03d7-4f9d-995c-0720aace9643\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"
Jul 18 03:51:52.826281 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.826239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.828634 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.828607    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3bc23e2-03d7-4f9d-995c-0720aace9643-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c64c8f96d-lggkx\" (UID: \"e3bc23e2-03d7-4f9d-995c-0720aace9643\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"
Jul 18 03:51:52.833298 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.833280    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bff4z\" (UniqueName: \"kubernetes.io/projected/e3bc23e2-03d7-4f9d-995c-0720aace9643-kube-api-access-bff4z\") pod \"managed-serviceaccount-addon-agent-7c64c8f96d-lggkx\" (UID: \"e3bc23e2-03d7-4f9d-995c-0720aace9643\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"
Jul 18 03:51:52.926959 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.926848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-hub\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.926959 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.926895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.926959 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.926918    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-ca\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.927243 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.927109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prq4k\" (UniqueName: \"kubernetes.io/projected/e95d1262-2304-41c7-aa47-603257961990-kube-api-access-prq4k\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.927243 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.927176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.927243 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.927220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e95d1262-2304-41c7-aa47-603257961990-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.927915 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.927892    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e95d1262-2304-41c7-aa47-603257961990-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.929414 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.929384    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-ca\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.929502 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.929410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.929793 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.929776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.929839 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.929778    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e95d1262-2304-41c7-aa47-603257961990-hub\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.933756 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.933730    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prq4k\" (UniqueName: \"kubernetes.io/projected/e95d1262-2304-41c7-aa47-603257961990-kube-api-access-prq4k\") pod \"cluster-proxy-proxy-agent-5fd8d6c66-s86g2\" (UID: \"e95d1262-2304-41c7-aa47-603257961990\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:52.973735 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:52.973700    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"
Jul 18 03:51:53.003988 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:53.003955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:51:53.103300 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:53.103267    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx"]
Jul 18 03:51:53.106395 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:51:53.106364    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3bc23e2_03d7_4f9d_995c_0720aace9643.slice/crio-911b4f85b8f4ddff3d5cc921d0592afd7ebe7b352e64629cdb11c4711e758335 WatchSource:0}: Error finding container 911b4f85b8f4ddff3d5cc921d0592afd7ebe7b352e64629cdb11c4711e758335: Status 404 returned error can't find the container with id 911b4f85b8f4ddff3d5cc921d0592afd7ebe7b352e64629cdb11c4711e758335
Jul 18 03:51:53.131125 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:53.131098    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"]
Jul 18 03:51:53.134695 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:51:53.134670    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode95d1262_2304_41c7_aa47_603257961990.slice/crio-3b88748950347a8ec6e996379cde83e3941acc6fc5b554aad04b192d7d5460a8 WatchSource:0}: Error finding container 3b88748950347a8ec6e996379cde83e3941acc6fc5b554aad04b192d7d5460a8: Status 404 returned error can't find the container with id 3b88748950347a8ec6e996379cde83e3941acc6fc5b554aad04b192d7d5460a8
Jul 18 03:51:53.147060 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:53.147031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx" event={"ID":"e3bc23e2-03d7-4f9d-995c-0720aace9643","Type":"ContainerStarted","Data":"911b4f85b8f4ddff3d5cc921d0592afd7ebe7b352e64629cdb11c4711e758335"}
Jul 18 03:51:53.147958 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:53.147939    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" event={"ID":"e95d1262-2304-41c7-aa47-603257961990","Type":"ContainerStarted","Data":"3b88748950347a8ec6e996379cde83e3941acc6fc5b554aad04b192d7d5460a8"}
Jul 18 03:51:56.162617 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:56.162494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx" event={"ID":"e3bc23e2-03d7-4f9d-995c-0720aace9643","Type":"ContainerStarted","Data":"036f6f81f2ee1041a22783e99b8332813d65549f4d69e49ac8b47f8452076e45"}
Jul 18 03:51:56.176196 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:56.176147    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx" podStartSLOduration=1.533079906 podStartE2EDuration="4.176132001s" totalImagesPullingTime="2.643052095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:51:56.175325631 +0000 UTC m=+114.071510831" watchObservedRunningTime="2026-07-18 03:51:56.176132001 +0000 UTC m=+114.072317192"
Jul 18 03:51:58.170548 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:58.170518    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" event={"ID":"e95d1262-2304-41c7-aa47-603257961990","Type":"ContainerStarted","Data":"f7a3a3a2d279fa04dc8bd7afa0652e80485975a77b44e0c8abf9ccd2e4c46276"}
Jul 18 03:51:58.170981 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:58.170563    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" event={"ID":"e95d1262-2304-41c7-aa47-603257961990","Type":"ContainerStarted","Data":"7d99c3af25954a474066f6d954171a039c304a9a7874d58b15ef723fb5495f21"}
Jul 18 03:51:59.177895 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:59.177861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" event={"ID":"e95d1262-2304-41c7-aa47-603257961990","Type":"ContainerStarted","Data":"af5511da2e2ac1dc3ce5bba0ca7d008e68b118010a474aa7273123bee99da4d7"}
Jul 18 03:51:59.194184 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:51:59.194133    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" podStartSLOduration=2.3315457139999998 podStartE2EDuration="7.194116597s" totalImagesPullingTime="4.862570883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:51:59.19246732 +0000 UTC m=+117.088652523" watchObservedRunningTime="2026-07-18 03:51:59.194116597 +0000 UTC m=+117.090301788"
Jul 18 03:52:12.264384 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:52:12.264346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:52:12.264837 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:52:12.264504    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 18 03:52:12.264837 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:52:12.264574    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:54:14.26455763 +0000 UTC m=+252.160742799 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : secret "metrics-daemon-secret" not found
Jul 18 03:52:41.977782 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:52:41.977730    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s6q77" podUID="9e657418-e3de-471d-b1a6-26019a3da8fa"
Jul 18 03:52:42.299217 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:52:42.299137    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s6q77"
Jul 18 03:52:42.687475 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:52:42.687389    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:52:46.807032 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:52:46.806977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:52:46.807503 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:52:46.807122    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 03:52:46.807503 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:52:46.807185    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls podName:9e657418-e3de-471d-b1a6-26019a3da8fa nodeName:}" failed. No retries permitted until 2026-07-18 03:54:48.807168264 +0000 UTC m=+286.703353436 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls") pod "dns-default-s6q77" (UID: "9e657418-e3de-471d-b1a6-26019a3da8fa") : secret "dns-default-metrics-tls" not found
Jul 18 03:52:56.679896 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:52:56.679827    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:53:56.504470 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:53:56.504433    2559 generic.go:356] "Generic (PLEG): container finished" podID="e3bc23e2-03d7-4f9d-995c-0720aace9643" containerID="036f6f81f2ee1041a22783e99b8332813d65549f4d69e49ac8b47f8452076e45" exitCode=255
Jul 18 03:53:56.504905 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:53:56.504505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx" event={"ID":"e3bc23e2-03d7-4f9d-995c-0720aace9643","Type":"ContainerDied","Data":"036f6f81f2ee1041a22783e99b8332813d65549f4d69e49ac8b47f8452076e45"}
Jul 18 03:53:56.504905 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:53:56.504826    2559 scope.go:117] "RemoveContainer" containerID="036f6f81f2ee1041a22783e99b8332813d65549f4d69e49ac8b47f8452076e45"
Jul 18 03:53:57.509203 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:53:57.509168    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c64c8f96d-lggkx" event={"ID":"e3bc23e2-03d7-4f9d-995c-0720aace9643","Type":"ContainerStarted","Data":"71064b5c3ef16b42586e53aa407f48db5224dfd1ad32c080849245346637e1fd"}
Jul 18 03:54:05.114156 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.114121    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d6sgk"]
Jul 18 03:54:05.117207 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.117191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.119746 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.119719    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 03:54:05.120083 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.120067    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 03:54:05.120157 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.120070    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 03:54:05.120572 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.120558    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wqk9w\""
Jul 18 03:54:05.120627 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.120612    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 03:54:05.129257 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.129232    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d6sgk"]
Jul 18 03:54:05.243699 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.243630    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcwg\" (UniqueName: \"kubernetes.io/projected/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-api-access-jpcwg\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.243877 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.243707    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.243877 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.243742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e726d1a-b9b5-4d24-8d8e-944743b29335-crio-socket\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.243877 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.243757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.243877 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.243868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e726d1a-b9b5-4d24-8d8e-944743b29335-data-volume\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.344547 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.344515    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.344717 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.344559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e726d1a-b9b5-4d24-8d8e-944743b29335-crio-socket\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.344717 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.344585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.344717 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.344622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e726d1a-b9b5-4d24-8d8e-944743b29335-data-volume\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.344717 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.344657    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e726d1a-b9b5-4d24-8d8e-944743b29335-crio-socket\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.344717 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:05.344683    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:05.344972 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:05.344719    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 03:54:05.344972 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.344728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcwg\" (UniqueName: \"kubernetes.io/projected/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-api-access-jpcwg\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.344972 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:05.344764    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:05.844748726 +0000 UTC m=+243.740933896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:05.344972 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:05.344787    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:05.844772586 +0000 UTC m=+243.740957755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : configmap "kube-rbac-proxy" not found
Jul 18 03:54:05.344972 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.344915    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e726d1a-b9b5-4d24-8d8e-944743b29335-data-volume\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.355451 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.355430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcwg\" (UniqueName: \"kubernetes.io/projected/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-api-access-jpcwg\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.849035 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.849000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.849035 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:05.849042    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:05.849240 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:05.849117    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 03:54:05.849240 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:05.849148    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:05.849240 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:05.849170    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:06.849155895 +0000 UTC m=+244.745341065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : configmap "kube-rbac-proxy" not found
Jul 18 03:54:05.849240 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:05.849224    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:06.849210233 +0000 UTC m=+244.745395405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:06.856284 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:06.856239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:06.856284 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:06.856291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:06.856798 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:06.856404    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 03:54:06.856798 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:06.856411    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:06.856798 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:06.856480    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.856461315 +0000 UTC m=+246.752646484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : configmap "kube-rbac-proxy" not found
Jul 18 03:54:06.856798 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:06.856501    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.856491947 +0000 UTC m=+246.752677116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:07.289428 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:07.289400    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mtcnq_0758e022-73b9-4f35-96e8-5d297cb56356/dns-node-resolver/0.log"
Jul 18 03:54:08.091862 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:08.091832    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p7ld9_958b9f76-31bd-4650-9982-96e485a636b9/node-ca/0.log"
Jul 18 03:54:08.870462 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:08.870409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:08.870462 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:08.870471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:08.870719 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:08.870557    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 03:54:08.870719 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:08.870565    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:08.870719 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:08.870620    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:12.870603672 +0000 UTC m=+250.766788844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:08.870719 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:08.870635    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:12.870629794 +0000 UTC m=+250.766814967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : configmap "kube-rbac-proxy" not found
Jul 18 03:54:09.089113 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:09.089084    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z79sn_201aa012-979d-450c-9f8c-3bdc4ada48c3/serve-healthcheck-canary/0.log"
Jul 18 03:54:12.899425 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:12.899383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:12.899425 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:12.899428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:12.899959 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:12.899491    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:12.899959 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:12.899553    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:20.899538482 +0000 UTC m=+258.795723651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : secret "insights-runtime-extractor-tls" not found
Jul 18 03:54:12.899959 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:12.899495    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 03:54:12.899959 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:12.899623    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm podName:3e726d1a-b9b5-4d24-8d8e-944743b29335 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:20.899612055 +0000 UTC m=+258.795797224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d6sgk" (UID: "3e726d1a-b9b5-4d24-8d8e-944743b29335") : configmap "kube-rbac-proxy" not found
Jul 18 03:54:14.308753 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:14.308712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:54:14.309138 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:14.308850    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 18 03:54:14.309138 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:14.308919    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs podName:65190cd9-1a6c-4358-9309-30c238568f7a nodeName:}" failed. No retries permitted until 2026-07-18 03:56:16.308900718 +0000 UTC m=+374.205085892 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs") pod "network-metrics-daemon-48dcs" (UID: "65190cd9-1a6c-4358-9309-30c238568f7a") : secret "metrics-daemon-secret" not found
Jul 18 03:54:20.953467 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:20.953433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:20.953937 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:20.953477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:20.954017 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:20.953999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e726d1a-b9b5-4d24-8d8e-944743b29335-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:20.955730 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:20.955706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e726d1a-b9b5-4d24-8d8e-944743b29335-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d6sgk\" (UID: \"3e726d1a-b9b5-4d24-8d8e-944743b29335\") " pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:21.026078 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:21.026019    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d6sgk"
Jul 18 03:54:21.154315 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:21.154287    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d6sgk"]
Jul 18 03:54:21.157686 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:54:21.157643    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e726d1a_b9b5_4d24_8d8e_944743b29335.slice/crio-50366be2a957c7cbc3e992d662f4a5d518013f5760d68908fdbd388dc59e6afd WatchSource:0}: Error finding container 50366be2a957c7cbc3e992d662f4a5d518013f5760d68908fdbd388dc59e6afd: Status 404 returned error can't find the container with id 50366be2a957c7cbc3e992d662f4a5d518013f5760d68908fdbd388dc59e6afd
Jul 18 03:54:21.580276 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:21.580238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d6sgk" event={"ID":"3e726d1a-b9b5-4d24-8d8e-944743b29335","Type":"ContainerStarted","Data":"50366be2a957c7cbc3e992d662f4a5d518013f5760d68908fdbd388dc59e6afd"}
Jul 18 03:54:23.006010 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:23.005954    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" podUID="e95d1262-2304-41c7-aa47-603257961990" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 18 03:54:26.597845 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:26.597810    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d6sgk" event={"ID":"3e726d1a-b9b5-4d24-8d8e-944743b29335","Type":"ContainerStarted","Data":"62b4247c6761728e79697cfb770b0e54bfa0da7e7ddfc722c848c39eab300412"}
Jul 18 03:54:28.793979 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.793941    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-6sb5r"]
Jul 18 03:54:28.816777 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.816749    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6sb5r"]
Jul 18 03:54:28.816951 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.816800    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54bb5cd49-47r8l"]
Jul 18 03:54:28.816951 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.816882    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6sb5r"
Jul 18 03:54:28.822735 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.819643    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kqfkb\""
Jul 18 03:54:28.822735 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.819830    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 18 03:54:28.822735 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.819678    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 18 03:54:28.825585 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.825559    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54bb5cd49-47r8l"]
Jul 18 03:54:28.825721 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.825630    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:28.827812 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.827789    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp4b6\""
Jul 18 03:54:28.827920 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.827881    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 18 03:54:28.827920 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.827893    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 18 03:54:28.828501 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.828149    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 18 03:54:28.832950 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.832927    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 18 03:54:28.913067 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.913027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cc6f894-009d-43a1-9f4d-44317d041674-trusted-ca\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:28.913239 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.913081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cc6f894-009d-43a1-9f4d-44317d041674-registry-certificates\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:28.913239 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.913193    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkbt5\" (UniqueName: \"kubernetes.io/projected/2f07f73f-dffd-4e5f-b72a-6c036260ef49-kube-api-access-hkbt5\") pod \"downloads-5bc67dcd46-6sb5r\" (UID: \"2f07f73f-dffd-4e5f-b72a-6c036260ef49\") " pod="openshift-console/downloads-5bc67dcd46-6sb5r"
Jul 18 03:54:28.913334 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.913234    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cc6f894-009d-43a1-9f4d-44317d041674-bound-sa-token\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:28.913334 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.913276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cc6f894-009d-43a1-9f4d-44317d041674-image-registry-private-configuration\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:28.913334 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.913307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc6f894-009d-43a1-9f4d-44317d041674-registry-tls\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:28.913469 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.913379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cc6f894-009d-43a1-9f4d-44317d041674-ca-trust-extracted\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:28.913469 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.913423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpl78\" (UniqueName: \"kubernetes.io/projected/0cc6f894-009d-43a1-9f4d-44317d041674-kube-api-access-gpl78\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:28.913469 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:28.913462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cc6f894-009d-43a1-9f4d-44317d041674-installation-pull-secrets\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.014233 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.014199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cc6f894-009d-43a1-9f4d-44317d041674-installation-pull-secrets\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.014413 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.014261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cc6f894-009d-43a1-9f4d-44317d041674-trusted-ca\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.014413 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.014290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cc6f894-009d-43a1-9f4d-44317d041674-registry-certificates\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.014413 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.014341    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkbt5\" (UniqueName: \"kubernetes.io/projected/2f07f73f-dffd-4e5f-b72a-6c036260ef49-kube-api-access-hkbt5\") pod \"downloads-5bc67dcd46-6sb5r\" (UID: \"2f07f73f-dffd-4e5f-b72a-6c036260ef49\") " pod="openshift-console/downloads-5bc67dcd46-6sb5r"
Jul 18 03:54:29.014413 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.014364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cc6f894-009d-43a1-9f4d-44317d041674-bound-sa-token\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.014629 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.014484    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cc6f894-009d-43a1-9f4d-44317d041674-image-registry-private-configuration\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.014629 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.014534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc6f894-009d-43a1-9f4d-44317d041674-registry-tls\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.014629 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.014583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cc6f894-009d-43a1-9f4d-44317d041674-ca-trust-extracted\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.014629 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.014608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpl78\" (UniqueName: \"kubernetes.io/projected/0cc6f894-009d-43a1-9f4d-44317d041674-kube-api-access-gpl78\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.015124 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.015096    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cc6f894-009d-43a1-9f4d-44317d041674-ca-trust-extracted\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.015346 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.015313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cc6f894-009d-43a1-9f4d-44317d041674-trusted-ca\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.015543 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.015522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cc6f894-009d-43a1-9f4d-44317d041674-registry-certificates\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.017420 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.017397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cc6f894-009d-43a1-9f4d-44317d041674-installation-pull-secrets\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.017512 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.017434    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cc6f894-009d-43a1-9f4d-44317d041674-registry-tls\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.017512 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.017466    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cc6f894-009d-43a1-9f4d-44317d041674-image-registry-private-configuration\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.021901 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.021864    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpl78\" (UniqueName: \"kubernetes.io/projected/0cc6f894-009d-43a1-9f4d-44317d041674-kube-api-access-gpl78\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.022008 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.021992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cc6f894-009d-43a1-9f4d-44317d041674-bound-sa-token\") pod \"image-registry-54bb5cd49-47r8l\" (UID: \"0cc6f894-009d-43a1-9f4d-44317d041674\") " pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.022922 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.022903    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkbt5\" (UniqueName: \"kubernetes.io/projected/2f07f73f-dffd-4e5f-b72a-6c036260ef49-kube-api-access-hkbt5\") pod \"downloads-5bc67dcd46-6sb5r\" (UID: \"2f07f73f-dffd-4e5f-b72a-6c036260ef49\") " pod="openshift-console/downloads-5bc67dcd46-6sb5r"
Jul 18 03:54:29.135054 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.134959    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6sb5r"
Jul 18 03:54:29.139682 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.139630    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:29.809285 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.808948    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54bb5cd49-47r8l"]
Jul 18 03:54:29.812396 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:54:29.812366    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc6f894_009d_43a1_9f4d_44317d041674.slice/crio-5f329a2ee8f0d4ad73b61f7f63abe0ecc00b28ed9492acfa9305354d428caa88 WatchSource:0}: Error finding container 5f329a2ee8f0d4ad73b61f7f63abe0ecc00b28ed9492acfa9305354d428caa88: Status 404 returned error can't find the container with id 5f329a2ee8f0d4ad73b61f7f63abe0ecc00b28ed9492acfa9305354d428caa88
Jul 18 03:54:29.823464 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:29.823431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6sb5r"]
Jul 18 03:54:29.827245 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:54:29.827216    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f07f73f_dffd_4e5f_b72a_6c036260ef49.slice/crio-f96fcfb20760060280fa0f5ef77871d65dbd988b29a77cbb20f2c37b2cf24e48 WatchSource:0}: Error finding container f96fcfb20760060280fa0f5ef77871d65dbd988b29a77cbb20f2c37b2cf24e48: Status 404 returned error can't find the container with id f96fcfb20760060280fa0f5ef77871d65dbd988b29a77cbb20f2c37b2cf24e48
Jul 18 03:54:30.613954 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:30.613910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d6sgk" event={"ID":"3e726d1a-b9b5-4d24-8d8e-944743b29335","Type":"ContainerStarted","Data":"6c5c87d9bfe837ba78f8db3565a905a7a43982985482bf041e133eabdfee91f1"}
Jul 18 03:54:30.615340 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:30.615300    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6sb5r" event={"ID":"2f07f73f-dffd-4e5f-b72a-6c036260ef49","Type":"ContainerStarted","Data":"f96fcfb20760060280fa0f5ef77871d65dbd988b29a77cbb20f2c37b2cf24e48"}
Jul 18 03:54:30.617085 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:30.617060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l" event={"ID":"0cc6f894-009d-43a1-9f4d-44317d041674","Type":"ContainerStarted","Data":"388b7380b47180631092ad9faf783a3f7536e4054b5ca9957e4b32dcece6cad0"}
Jul 18 03:54:30.617204 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:30.617103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l" event={"ID":"0cc6f894-009d-43a1-9f4d-44317d041674","Type":"ContainerStarted","Data":"5f329a2ee8f0d4ad73b61f7f63abe0ecc00b28ed9492acfa9305354d428caa88"}
Jul 18 03:54:30.617265 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:30.617208    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:54:30.635264 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:30.635203    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l" podStartSLOduration=2.635188022 podStartE2EDuration="2.635188022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:30.633760018 +0000 UTC m=+268.529945234" watchObservedRunningTime="2026-07-18 03:54:30.635188022 +0000 UTC m=+268.531373213"
Jul 18 03:54:33.006008 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:33.005963    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" podUID="e95d1262-2304-41c7-aa47-603257961990" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 18 03:54:34.632729 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:34.632683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d6sgk" event={"ID":"3e726d1a-b9b5-4d24-8d8e-944743b29335","Type":"ContainerStarted","Data":"d1acdf336dcc992d9855b5b6b2fbb595663f7adcae98ebe63dce2dcc9a378cae"}
Jul 18 03:54:34.648336 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:34.648280    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d6sgk" podStartSLOduration=17.306961211 podStartE2EDuration="29.648260154s" totalImagesPullingTime="12.341298943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:54:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:34.647192929 +0000 UTC m=+272.543378120" watchObservedRunningTime="2026-07-18 03:54:34.648260154 +0000 UTC m=+272.544445344"
Jul 18 03:54:42.765200 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.765162    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7s6r2"]
Jul 18 03:54:42.771684 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.771632    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.774020 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.773979    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 03:54:42.774020 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.774012    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 03:54:42.774199 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.774018    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 03:54:42.774975 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.774809    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 03:54:42.774975 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.774862    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 03:54:42.774975 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.774872    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-np8nl\""
Jul 18 03:54:42.774975 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.774865    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 03:54:42.838799 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.838761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-metrics-client-ca\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.838987 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.838812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.838987 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.838899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-root\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.838987 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.838959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-accelerators-collector-config\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.839136 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.839004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-textfile\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.839136 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.839092    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-wtmp\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.839210 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.839135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-sys\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.839210 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.839166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-tls\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.839210 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.839196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4745v\" (UniqueName: \"kubernetes.io/projected/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-kube-api-access-4745v\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.940538 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-metrics-client-ca\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.940538 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.940845 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-root\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.940845 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940770    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-accelerators-collector-config\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.940845 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-root\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.940845 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940820    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-textfile\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.941102 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-wtmp\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.941102 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-sys\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.941102 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-tls\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.941102 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.940963    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4745v\" (UniqueName: \"kubernetes.io/projected/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-kube-api-access-4745v\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.941102 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.941018    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-sys\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.941102 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.941038    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-wtmp\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.941374 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.941264    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-metrics-client-ca\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.941432 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.941411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-textfile\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.941468 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.941449    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-accelerators-collector-config\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.943358 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.943314    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.943744 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.943707    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-node-exporter-tls\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:42.948479 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:42.948457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4745v\" (UniqueName: \"kubernetes.io/projected/bf96301a-60e8-4e7c-bc85-76a17d3a3de0-kube-api-access-4745v\") pod \"node-exporter-7s6r2\" (UID: \"bf96301a-60e8-4e7c-bc85-76a17d3a3de0\") " pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:43.006169 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:43.006131    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" podUID="e95d1262-2304-41c7-aa47-603257961990" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 18 03:54:43.006341 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:43.006215    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2"
Jul 18 03:54:43.006810 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:43.006769    2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"af5511da2e2ac1dc3ce5bba0ca7d008e68b118010a474aa7273123bee99da4d7"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 18 03:54:43.006906 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:43.006831    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" podUID="e95d1262-2304-41c7-aa47-603257961990" containerName="service-proxy" containerID="cri-o://af5511da2e2ac1dc3ce5bba0ca7d008e68b118010a474aa7273123bee99da4d7" gracePeriod=30
Jul 18 03:54:43.082576 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:43.082540    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7s6r2"
Jul 18 03:54:45.300209 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:45.300161    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s6q77" podUID="9e657418-e3de-471d-b1a6-26019a3da8fa"
Jul 18 03:54:45.671004 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:45.670918    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s6q77"
Jul 18 03:54:46.338336 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:54:46.338305    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf96301a_60e8_4e7c_bc85_76a17d3a3de0.slice/crio-e133a3747bba01336fade700edc230e235395b0f757f1016423bbd575478e908 WatchSource:0}: Error finding container e133a3747bba01336fade700edc230e235395b0f757f1016423bbd575478e908: Status 404 returned error can't find the container with id e133a3747bba01336fade700edc230e235395b0f757f1016423bbd575478e908
Jul 18 03:54:46.675768 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:46.675685    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6sb5r" event={"ID":"2f07f73f-dffd-4e5f-b72a-6c036260ef49","Type":"ContainerStarted","Data":"4965a1cfdb003a69cd709796f30e5aea765abbe11f97919c87483b1f599c6682"}
Jul 18 03:54:46.675995 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:46.675978    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-6sb5r"
Jul 18 03:54:46.679706 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:46.679671    2559 generic.go:356] "Generic (PLEG): container finished" podID="e95d1262-2304-41c7-aa47-603257961990" containerID="af5511da2e2ac1dc3ce5bba0ca7d008e68b118010a474aa7273123bee99da4d7" exitCode=2
Jul 18 03:54:46.681101 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:46.681071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7s6r2" event={"ID":"bf96301a-60e8-4e7c-bc85-76a17d3a3de0","Type":"ContainerStarted","Data":"e133a3747bba01336fade700edc230e235395b0f757f1016423bbd575478e908"}
Jul 18 03:54:46.681209 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:46.681123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" event={"ID":"e95d1262-2304-41c7-aa47-603257961990","Type":"ContainerDied","Data":"af5511da2e2ac1dc3ce5bba0ca7d008e68b118010a474aa7273123bee99da4d7"}
Jul 18 03:54:46.681209 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:46.681153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fd8d6c66-s86g2" event={"ID":"e95d1262-2304-41c7-aa47-603257961990","Type":"ContainerStarted","Data":"df3d67ef3c5f793899bd2189e61ca6861e92652715b52521795b46e7e996f7ed"}
Jul 18 03:54:46.691219 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:46.691159    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-6sb5r" podStartSLOduration=2.0838189480000002 podStartE2EDuration="18.691145908s" totalImagesPullingTime="16.60732696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:46.690621267 +0000 UTC m=+284.586806460" watchObservedRunningTime="2026-07-18 03:54:46.691145908 +0000 UTC m=+284.587331121"
Jul 18 03:54:46.692775 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:46.692751    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-6sb5r"
Jul 18 03:54:47.685921 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.685825    2559 generic.go:356] "Generic (PLEG): container finished" podID="bf96301a-60e8-4e7c-bc85-76a17d3a3de0" containerID="720150637ae2394f99c3fc5f5afa71b59ee1adc8c5400098882676b45c56a733" exitCode=0
Jul 18 03:54:47.686384 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.685924    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7s6r2" event={"ID":"bf96301a-60e8-4e7c-bc85-76a17d3a3de0","Type":"ContainerDied","Data":"720150637ae2394f99c3fc5f5afa71b59ee1adc8c5400098882676b45c56a733"}
Jul 18 03:54:47.946672 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.946622    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65b97c755f-md4l6"]
Jul 18 03:54:47.972613 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.972574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65b97c755f-md4l6"]
Jul 18 03:54:47.972816 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.972730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:47.974969 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.974942    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 18 03:54:47.975244 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.975222    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 18 03:54:47.975617 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.975599    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zjnjm\""
Jul 18 03:54:47.976214 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.976102    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 18 03:54:47.976321 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.976292    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 18 03:54:47.976503 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.976486    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 18 03:54:47.980688 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:47.980666    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 18 03:54:48.081619 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.081581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-federate-client-tls\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.081619 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.081622    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bfaef66-4b8b-4f2a-8b95-d78a29001531-metrics-client-ca\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.081900 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.081666    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bfaef66-4b8b-4f2a-8b95-d78a29001531-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.081900 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.081724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-secret-telemeter-client\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.081900 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.081869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bfaef66-4b8b-4f2a-8b95-d78a29001531-serving-certs-ca-bundle\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.082053 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.081923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.082053 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.082007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvw9x\" (UniqueName: \"kubernetes.io/projected/1bfaef66-4b8b-4f2a-8b95-d78a29001531-kube-api-access-gvw9x\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.082151 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.082130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-telemeter-client-tls\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.183463 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.183419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-telemeter-client-tls\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.183643 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.183477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-federate-client-tls\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.184005 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.183752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bfaef66-4b8b-4f2a-8b95-d78a29001531-metrics-client-ca\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.184005 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.183809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bfaef66-4b8b-4f2a-8b95-d78a29001531-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.184005 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.183839    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-secret-telemeter-client\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.184005 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.183897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bfaef66-4b8b-4f2a-8b95-d78a29001531-serving-certs-ca-bundle\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.184005 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.183938    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.184005 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.183973    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvw9x\" (UniqueName: \"kubernetes.io/projected/1bfaef66-4b8b-4f2a-8b95-d78a29001531-kube-api-access-gvw9x\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.184740 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.184636    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bfaef66-4b8b-4f2a-8b95-d78a29001531-metrics-client-ca\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.184968 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.184945    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bfaef66-4b8b-4f2a-8b95-d78a29001531-serving-certs-ca-bundle\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.185704 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.185629    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bfaef66-4b8b-4f2a-8b95-d78a29001531-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.186879 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.186822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-federate-client-tls\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.187258 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.187215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.187348 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.187317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-telemeter-client-tls\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.188472 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.188445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1bfaef66-4b8b-4f2a-8b95-d78a29001531-secret-telemeter-client\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.191458 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.191431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvw9x\" (UniqueName: \"kubernetes.io/projected/1bfaef66-4b8b-4f2a-8b95-d78a29001531-kube-api-access-gvw9x\") pod \"telemeter-client-65b97c755f-md4l6\" (UID: \"1bfaef66-4b8b-4f2a-8b95-d78a29001531\") " pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.286926 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.286883    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6"
Jul 18 03:54:48.476274 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.476233    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65b97c755f-md4l6"]
Jul 18 03:54:48.481586 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:54:48.481554    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bfaef66_4b8b_4f2a_8b95_d78a29001531.slice/crio-206eefc6a9df82d93d32102854ec5bf679e01526e97e36bec9dc4db57b619240 WatchSource:0}: Error finding container 206eefc6a9df82d93d32102854ec5bf679e01526e97e36bec9dc4db57b619240: Status 404 returned error can't find the container with id 206eefc6a9df82d93d32102854ec5bf679e01526e97e36bec9dc4db57b619240
Jul 18 03:54:48.692809 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.692690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7s6r2" event={"ID":"bf96301a-60e8-4e7c-bc85-76a17d3a3de0","Type":"ContainerStarted","Data":"7f995ba7b7d8a411443edb3c7e9526ca76cacfc5326409e0c8bff5ac5fab18f0"}
Jul 18 03:54:48.692809 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.692755    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7s6r2" event={"ID":"bf96301a-60e8-4e7c-bc85-76a17d3a3de0","Type":"ContainerStarted","Data":"ab9d684ffb67cbf2c51dd62251a1a08031ff6886741dcd91566d6b8ea99bee64"}
Jul 18 03:54:48.694314 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.694279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6" event={"ID":"1bfaef66-4b8b-4f2a-8b95-d78a29001531","Type":"ContainerStarted","Data":"206eefc6a9df82d93d32102854ec5bf679e01526e97e36bec9dc4db57b619240"}
Jul 18 03:54:48.734382 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.734283    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7s6r2" podStartSLOduration=5.694076795 podStartE2EDuration="6.734259032s" totalImagesPullingTime="962.520412ms" totalInitContainerRuntime="77.661825ms" isStatefulPod=true podCreationTimestamp="2026-07-18 03:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:48.733042837 +0000 UTC m=+286.629228055" watchObservedRunningTime="2026-07-18 03:54:48.734259032 +0000 UTC m=+286.630444224"
Jul 18 03:54:48.889694 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.889637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:54:48.892331 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.892294    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e657418-e3de-471d-b1a6-26019a3da8fa-metrics-tls\") pod \"dns-default-s6q77\" (UID: \"9e657418-e3de-471d-b1a6-26019a3da8fa\") " pod="openshift-dns/dns-default-s6q77"
Jul 18 03:54:48.916184 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.915888    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 03:54:48.938021 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.937984    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 03:54:48.938174 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.938115    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:48.940060 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.940036    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 03:54:48.940298 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.940188    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 03:54:48.940419 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.940332    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 03:54:48.940489 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.940438    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8kp2n\""
Jul 18 03:54:48.940787 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.940764    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 03:54:48.940886 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.940839    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 03:54:48.940886 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.940839    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 03:54:48.940987 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.940890    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 03:54:48.941147 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.941126    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 03:54:48.941254 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.941155    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 03:54:48.941254 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.941193    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 03:54:48.941711 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.941485    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-btsrbq4v4gapv\""
Jul 18 03:54:48.941711 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.941550    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 03:54:48.941711 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.941568    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 03:54:48.941890 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.941839    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 03:54:48.942089 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.942056    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 03:54:48.943802 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.943786    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 03:54:48.974470 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.974441    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rnqn\""
Jul 18 03:54:48.983134 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:48.983105    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s6q77"
Jul 18 03:54:49.091198 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091161    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-config\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091360 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091360 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091360 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091360 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79b2d740-489f-40f7-a8d6-3e662859b46a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091360 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79b2d740-489f-40f7-a8d6-3e662859b46a-config-out\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091565 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091565 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091565 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091565 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091565 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-web-config\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091832 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091585    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091832 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091832 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091727    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091832 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091832 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.091832 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.092114 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.092114 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6gwk\" (UniqueName: \"kubernetes.io/projected/79b2d740-489f-40f7-a8d6-3e662859b46a-kube-api-access-d6gwk\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.092114 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.091907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.146363 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.146312    2559 patch_prober.go:28] interesting pod/image-registry-54bb5cd49-47r8l container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 03:54:49.146530 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.146377    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l" podUID="0cc6f894-009d-43a1-9f4d-44317d041674" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 03:54:49.150636 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.150606    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s6q77"]
Jul 18 03:54:49.158341 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:54:49.158310    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e657418_e3de_471d_b1a6_26019a3da8fa.slice/crio-d8e8d9cdbb3bae0c8251b8adfc502b8cb70428d765db94c7ca5c585f0357b011 WatchSource:0}: Error finding container d8e8d9cdbb3bae0c8251b8adfc502b8cb70428d765db94c7ca5c585f0357b011: Status 404 returned error can't find the container with id d8e8d9cdbb3bae0c8251b8adfc502b8cb70428d765db94c7ca5c585f0357b011
Jul 18 03:54:49.192608 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-config\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.192608 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.192904 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.192904 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.192904 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192755    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79b2d740-489f-40f7-a8d6-3e662859b46a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.192904 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79b2d740-489f-40f7-a8d6-3e662859b46a-config-out\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.192904 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.192904 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.192904 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.192904 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192900    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-web-config\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.192991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.193021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.193044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.193099    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.193126    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.193157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.193181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6gwk\" (UniqueName: \"kubernetes.io/projected/79b2d740-489f-40f7-a8d6-3e662859b46a-kube-api-access-d6gwk\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.193302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.193213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.194498 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.194335    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.194498 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.194444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.195148 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.194940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.195733 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.195575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.198047 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.197354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.198047 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.197397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.198047 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.197882    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.198242 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.198189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79b2d740-489f-40f7-a8d6-3e662859b46a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.200323 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.200299    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b2d740-489f-40f7-a8d6-3e662859b46a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.200854 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.200824    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79b2d740-489f-40f7-a8d6-3e662859b46a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.203803 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.203777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.204392 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.204365    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.206014 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.204751    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.207312 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.207216    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.207507 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.207487    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-web-config\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.208428 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.208373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-config\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.209138 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.209111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79b2d740-489f-40f7-a8d6-3e662859b46a-config-out\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.209815 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.209756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.210083 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.210045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79b2d740-489f-40f7-a8d6-3e662859b46a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.213742 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.213711    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6gwk\" (UniqueName: \"kubernetes.io/projected/79b2d740-489f-40f7-a8d6-3e662859b46a-kube-api-access-d6gwk\") pod \"prometheus-k8s-0\" (UID: \"79b2d740-489f-40f7-a8d6-3e662859b46a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.251667 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.251473    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:54:49.484807 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.484754    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 03:54:49.491991 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:54:49.491934    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b2d740_489f_40f7_a8d6_3e662859b46a.slice/crio-0d3ba18db000435dc66ecbf0bdcbeb1aac8ffe7ff02c7f292aac3c88f8f523d2 WatchSource:0}: Error finding container 0d3ba18db000435dc66ecbf0bdcbeb1aac8ffe7ff02c7f292aac3c88f8f523d2: Status 404 returned error can't find the container with id 0d3ba18db000435dc66ecbf0bdcbeb1aac8ffe7ff02c7f292aac3c88f8f523d2
Jul 18 03:54:49.701696 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.701593    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79b2d740-489f-40f7-a8d6-3e662859b46a","Type":"ContainerStarted","Data":"0d3ba18db000435dc66ecbf0bdcbeb1aac8ffe7ff02c7f292aac3c88f8f523d2"}
Jul 18 03:54:49.704039 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:49.704006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s6q77" event={"ID":"9e657418-e3de-471d-b1a6-26019a3da8fa","Type":"ContainerStarted","Data":"d8e8d9cdbb3bae0c8251b8adfc502b8cb70428d765db94c7ca5c585f0357b011"}
Jul 18 03:54:51.626515 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:51.626471    2559 patch_prober.go:28] interesting pod/image-registry-54bb5cd49-47r8l container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 03:54:51.627084 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:51.626547    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l" podUID="0cc6f894-009d-43a1-9f4d-44317d041674" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 03:54:52.720068 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:52.720035    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6" event={"ID":"1bfaef66-4b8b-4f2a-8b95-d78a29001531","Type":"ContainerStarted","Data":"15a9fceb6e9bf0af0b9aed3be72dfcf5b5cd97b29a48d0d36fcf3d94bfec73bd"}
Jul 18 03:54:52.720514 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:52.720101    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6" event={"ID":"1bfaef66-4b8b-4f2a-8b95-d78a29001531","Type":"ContainerStarted","Data":"486202989b53aafcacbe60d80d1b10929f5ab1a32ced92148e0161bd82f2776e"}
Jul 18 03:54:52.721759 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:52.721731    2559 generic.go:356] "Generic (PLEG): container finished" podID="79b2d740-489f-40f7-a8d6-3e662859b46a" containerID="038dce5003905e9f598819162cfea13ec91c428956dcdc010e2540402725175b" exitCode=0
Jul 18 03:54:52.721876 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:52.721825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79b2d740-489f-40f7-a8d6-3e662859b46a","Type":"ContainerDied","Data":"038dce5003905e9f598819162cfea13ec91c428956dcdc010e2540402725175b"}
Jul 18 03:54:52.723831 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:52.723778    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s6q77" event={"ID":"9e657418-e3de-471d-b1a6-26019a3da8fa","Type":"ContainerStarted","Data":"b8c40fdbd80412c9a9ffb09cf6b2a2a949d3e2d96b15c59a80b8cd0b6dc8ae8b"}
Jul 18 03:54:52.723831 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:52.723823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s6q77" event={"ID":"9e657418-e3de-471d-b1a6-26019a3da8fa","Type":"ContainerStarted","Data":"5cbb3b1e29e529ef8accd21db887b1c612829cfc59e2a4ac8571f92a4b3da0cc"}
Jul 18 03:54:52.724051 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:52.724029    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s6q77"
Jul 18 03:54:52.765704 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:52.765635    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s6q77" podStartSLOduration=251.62288662 podStartE2EDuration="4m14.765617601s" totalImagesPullingTime="3.142730981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:52.764327127 +0000 UTC m=+290.660512341" watchObservedRunningTime="2026-07-18 03:54:52.765617601 +0000 UTC m=+290.661802794"
Jul 18 03:54:53.736231 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:53.736163    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6" event={"ID":"1bfaef66-4b8b-4f2a-8b95-d78a29001531","Type":"ContainerStarted","Data":"5c40ca0bdbdc93a738cb6d265a08b051b48aaf7c1ea907282c72d5d55287808f"}
Jul 18 03:54:53.757487 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:53.757201    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65b97c755f-md4l6" podStartSLOduration=2.943669937 podStartE2EDuration="6.757176823s" totalImagesPullingTime="3.813506886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:53.756153945 +0000 UTC m=+291.652339167" watchObservedRunningTime="2026-07-18 03:54:53.757176823 +0000 UTC m=+291.653362015"
Jul 18 03:54:56.752620 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:56.752589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79b2d740-489f-40f7-a8d6-3e662859b46a","Type":"ContainerStarted","Data":"d14154ded129681e7046db09f507c4dc1f5f31691a4d9dd2e3cb0daf267a959b"}
Jul 18 03:54:57.759005 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:57.758968    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79b2d740-489f-40f7-a8d6-3e662859b46a","Type":"ContainerStarted","Data":"fefb29f5e6f3fd2c8d9b958528bd90bdc53609f2d08214e5515e33aa304e648c"}
Jul 18 03:54:59.143839 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:59.143804    2559 patch_prober.go:28] interesting pod/image-registry-54bb5cd49-47r8l container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 03:54:59.144274 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:59.143853    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l" podUID="0cc6f894-009d-43a1-9f4d-44317d041674" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 03:54:59.680493 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:54:59.680396    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-48dcs" podUID="65190cd9-1a6c-4358-9309-30c238568f7a"
Jul 18 03:54:59.770384 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:59.770348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79b2d740-489f-40f7-a8d6-3e662859b46a","Type":"ContainerStarted","Data":"11e08531183de126d2e97459a9d107c512283cff5fc8691599192ef4a387e9cf"}
Jul 18 03:54:59.770567 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:59.770408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79b2d740-489f-40f7-a8d6-3e662859b46a","Type":"ContainerStarted","Data":"d8ef4567557fe2d7a7b2efc95140a5aeba5699cd1b7a8d03ed0b66d5dd8dac2d"}
Jul 18 03:54:59.770567 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:59.770435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79b2d740-489f-40f7-a8d6-3e662859b46a","Type":"ContainerStarted","Data":"dcd5db1b6e19e674df94bb064a9415ad4d737ee9ad23fbcf5ea7c59daca114f8"}
Jul 18 03:54:59.770567 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:59.770458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79b2d740-489f-40f7-a8d6-3e662859b46a","Type":"ContainerStarted","Data":"afbdd00629749b4cea176a59387dcc69d188562c88e3cc9be2bc9e589042150b"}
Jul 18 03:54:59.797885 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:54:59.797820    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.729773054 podStartE2EDuration="11.797798571s" totalImagesPullingTime="9.037434058s" totalInitContainerRuntime="30.591459ms" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:59.796163719 +0000 UTC m=+297.692349108" watchObservedRunningTime="2026-07-18 03:54:59.797798571 +0000 UTC m=+297.693983764"
Jul 18 03:55:01.625148 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:55:01.625119    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54bb5cd49-47r8l"
Jul 18 03:55:02.432505 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:55:02.432481    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 03:55:02.738976 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:55:02.738944    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s6q77"
Jul 18 03:55:04.251946 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:55:04.251897    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:55:12.678637 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:55:12.678598    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:55:49.252191 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:55:49.252131    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:55:49.270635 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:55:49.270609    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:55:49.971299 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:55:49.971275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 03:56:16.367138 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:16.367052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:56:16.369414 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:16.369388    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65190cd9-1a6c-4358-9309-30c238568f7a-metrics-certs\") pod \"network-metrics-daemon-48dcs\" (UID: \"65190cd9-1a6c-4358-9309-30c238568f7a\") " pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:56:16.582097 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:16.582068    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g4mng\""
Jul 18 03:56:16.590165 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:16.590142    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-48dcs"
Jul 18 03:56:16.717664 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:16.717621    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-48dcs"]
Jul 18 03:56:16.721115 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:56:16.721072    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65190cd9_1a6c_4358_9309_30c238568f7a.slice/crio-80b2356660a32de5ba3eee35de3fd2683cdfeab82d23da7802f32b680d2cd1b1 WatchSource:0}: Error finding container 80b2356660a32de5ba3eee35de3fd2683cdfeab82d23da7802f32b680d2cd1b1: Status 404 returned error can't find the container with id 80b2356660a32de5ba3eee35de3fd2683cdfeab82d23da7802f32b680d2cd1b1
Jul 18 03:56:16.723098 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:16.723079    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 03:56:17.055046 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:17.055008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48dcs" event={"ID":"65190cd9-1a6c-4358-9309-30c238568f7a","Type":"ContainerStarted","Data":"80b2356660a32de5ba3eee35de3fd2683cdfeab82d23da7802f32b680d2cd1b1"}
Jul 18 03:56:18.060378 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:18.060341    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48dcs" event={"ID":"65190cd9-1a6c-4358-9309-30c238568f7a","Type":"ContainerStarted","Data":"e74b2101fa7709245862bf349477ab57fa45697575da163854dd27719f288fef"}
Jul 18 03:56:18.060787 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:18.060402    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-48dcs" event={"ID":"65190cd9-1a6c-4358-9309-30c238568f7a","Type":"ContainerStarted","Data":"c4cfa18ccef294327a759052a0b9b7ccf8b2089d9149ee45eb5d170a3eb2056a"}
Jul 18 03:56:18.075718 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:56:18.075667    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-48dcs" podStartSLOduration=374.195519428 podStartE2EDuration="6m15.075630418s" totalImagesPullingTime="880.11099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:56:18.074530855 +0000 UTC m=+375.970716074" watchObservedRunningTime="2026-07-18 03:56:18.075630418 +0000 UTC m=+375.971815806"
Jul 18 03:57:59.150914 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.150882    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"]
Jul 18 03:57:59.154158 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.154138    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.156360 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.156328    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 03:57:59.156474 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.156393    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 03:57:59.156474 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.156338    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l7xz5\""
Jul 18 03:57:59.156964 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.156944    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 03:57:59.157078 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.156951    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 03:57:59.166886 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.166863    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"]
Jul 18 03:57:59.308496 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.308458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td56t\" (UniqueName: \"kubernetes.io/projected/1c973f32-827a-4362-868f-d2933eaf6939-kube-api-access-td56t\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.308688 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.308507    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c973f32-827a-4362-868f-d2933eaf6939-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.308688 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.308535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1c973f32-827a-4362-868f-d2933eaf6939-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.308688 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.308604    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c973f32-827a-4362-868f-d2933eaf6939-tmp\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.308688 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.308638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1c973f32-827a-4362-868f-d2933eaf6939-manifests\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.409905 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.409799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td56t\" (UniqueName: \"kubernetes.io/projected/1c973f32-827a-4362-868f-d2933eaf6939-kube-api-access-td56t\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.409905 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.409883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c973f32-827a-4362-868f-d2933eaf6939-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.410131 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.409932    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1c973f32-827a-4362-868f-d2933eaf6939-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.410131 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.409985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c973f32-827a-4362-868f-d2933eaf6939-tmp\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.410131 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.410015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1c973f32-827a-4362-868f-d2933eaf6939-manifests\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.410519 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.410492    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1c973f32-827a-4362-868f-d2933eaf6939-manifests\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.412188 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.412161    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c973f32-827a-4362-868f-d2933eaf6939-tmp\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.412475 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.412457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c973f32-827a-4362-868f-d2933eaf6939-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.412594 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.412573    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1c973f32-827a-4362-868f-d2933eaf6939-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.427889 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.427860    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td56t\" (UniqueName: \"kubernetes.io/projected/1c973f32-827a-4362-868f-d2933eaf6939-kube-api-access-td56t\") pod \"opendatahub-operator-controller-manager-5f994c8d8-jv5gx\" (UID: \"1c973f32-827a-4362-868f-d2933eaf6939\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.463837 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.463801    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:57:59.601730 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:57:59.601688    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"]
Jul 18 03:57:59.604623 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:57:59.604593    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c973f32_827a_4362_868f_d2933eaf6939.slice/crio-7c69c120775dd1bf00032057f6f98f485cf078b1605fa52972a3a477cae26960 WatchSource:0}: Error finding container 7c69c120775dd1bf00032057f6f98f485cf078b1605fa52972a3a477cae26960: Status 404 returned error can't find the container with id 7c69c120775dd1bf00032057f6f98f485cf078b1605fa52972a3a477cae26960
Jul 18 03:58:00.425132 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:00.425088    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx" event={"ID":"1c973f32-827a-4362-868f-d2933eaf6939","Type":"ContainerStarted","Data":"7c69c120775dd1bf00032057f6f98f485cf078b1605fa52972a3a477cae26960"}
Jul 18 03:58:03.438619 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:03.438580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx" event={"ID":"1c973f32-827a-4362-868f-d2933eaf6939","Type":"ContainerStarted","Data":"db1db4deec645659a109c24ae646d93176b5fbbe6a2ae106b23126a76892925c"}
Jul 18 03:58:04.444242 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:04.444204    2559 generic.go:356] "Generic (PLEG): container finished" podID="1c973f32-827a-4362-868f-d2933eaf6939" containerID="db1db4deec645659a109c24ae646d93176b5fbbe6a2ae106b23126a76892925c" exitCode=0
Jul 18 03:58:04.444626 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:04.444289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx" event={"ID":"1c973f32-827a-4362-868f-d2933eaf6939","Type":"ContainerDied","Data":"db1db4deec645659a109c24ae646d93176b5fbbe6a2ae106b23126a76892925c"}
Jul 18 03:58:05.450376 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:05.450341    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx" event={"ID":"1c973f32-827a-4362-868f-d2933eaf6939","Type":"ContainerStarted","Data":"98166b576d067b51aed5962aae0e2dc456f97e5d7c76aaec3a3323f7f78e97b1"}
Jul 18 03:58:05.450785 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:05.450462    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:58:05.471217 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:05.471168    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx" podStartSLOduration=2.174352476 podStartE2EDuration="6.471149843s" totalImagesPullingTime="3.25383853s" totalInitContainerRuntime="1.042958837s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:57:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:05.469105863 +0000 UTC m=+483.365291066" watchObservedRunningTime="2026-07-18 03:58:05.471149843 +0000 UTC m=+483.367335063"
Jul 18 03:58:16.456127 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:16.456092    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-jv5gx"
Jul 18 03:58:20.131099 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.131064    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"]
Jul 18 03:58:20.141898 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.141868    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.144302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.144108    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 18 03:58:20.144302 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.144276    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"]
Jul 18 03:58:20.144467 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.144308    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pp46s\""
Jul 18 03:58:20.144981 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.144960    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 18 03:58:20.145088 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.144991    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 03:58:20.145088 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.144996    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 03:58:20.186308 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.186271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b08023ec-5f1b-403f-a459-bff9a0e1ee71-tls-certs\") pod \"kube-auth-proxy-85c5cf7cfd-k8dxm\" (UID: \"b08023ec-5f1b-403f-a459-bff9a0e1ee71\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.186481 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.186328    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt9h4\" (UniqueName: \"kubernetes.io/projected/b08023ec-5f1b-403f-a459-bff9a0e1ee71-kube-api-access-qt9h4\") pod \"kube-auth-proxy-85c5cf7cfd-k8dxm\" (UID: \"b08023ec-5f1b-403f-a459-bff9a0e1ee71\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.186481 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.186403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b08023ec-5f1b-403f-a459-bff9a0e1ee71-tmp\") pod \"kube-auth-proxy-85c5cf7cfd-k8dxm\" (UID: \"b08023ec-5f1b-403f-a459-bff9a0e1ee71\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.287508 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.287470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b08023ec-5f1b-403f-a459-bff9a0e1ee71-tls-certs\") pod \"kube-auth-proxy-85c5cf7cfd-k8dxm\" (UID: \"b08023ec-5f1b-403f-a459-bff9a0e1ee71\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.287745 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.287521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt9h4\" (UniqueName: \"kubernetes.io/projected/b08023ec-5f1b-403f-a459-bff9a0e1ee71-kube-api-access-qt9h4\") pod \"kube-auth-proxy-85c5cf7cfd-k8dxm\" (UID: \"b08023ec-5f1b-403f-a459-bff9a0e1ee71\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.287745 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.287546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b08023ec-5f1b-403f-a459-bff9a0e1ee71-tmp\") pod \"kube-auth-proxy-85c5cf7cfd-k8dxm\" (UID: \"b08023ec-5f1b-403f-a459-bff9a0e1ee71\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.289880 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.289859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b08023ec-5f1b-403f-a459-bff9a0e1ee71-tmp\") pod \"kube-auth-proxy-85c5cf7cfd-k8dxm\" (UID: \"b08023ec-5f1b-403f-a459-bff9a0e1ee71\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.290132 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.290108    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b08023ec-5f1b-403f-a459-bff9a0e1ee71-tls-certs\") pod \"kube-auth-proxy-85c5cf7cfd-k8dxm\" (UID: \"b08023ec-5f1b-403f-a459-bff9a0e1ee71\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.300344 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.300322    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt9h4\" (UniqueName: \"kubernetes.io/projected/b08023ec-5f1b-403f-a459-bff9a0e1ee71-kube-api-access-qt9h4\") pod \"kube-auth-proxy-85c5cf7cfd-k8dxm\" (UID: \"b08023ec-5f1b-403f-a459-bff9a0e1ee71\") " pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.451956 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.451849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"
Jul 18 03:58:20.581219 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:20.581190    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm"]
Jul 18 03:58:20.583843 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:58:20.583814    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08023ec_5f1b_403f_a459_bff9a0e1ee71.slice/crio-057a472558865a7adcb916f176c8465e6b3fd8a2732a966af05314be0592f04d WatchSource:0}: Error finding container 057a472558865a7adcb916f176c8465e6b3fd8a2732a966af05314be0592f04d: Status 404 returned error can't find the container with id 057a472558865a7adcb916f176c8465e6b3fd8a2732a966af05314be0592f04d
Jul 18 03:58:21.154153 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.154122    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"]
Jul 18 03:58:21.157221 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.157203    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.159234 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.159211    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 18 03:58:21.159367 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.159214    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 18 03:58:21.159367 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.159218    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 18 03:58:21.159459 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.159370    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kctdz\""
Jul 18 03:58:21.160165 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.160145    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 03:58:21.170783 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.170756    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"]
Jul 18 03:58:21.194956 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.194926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.195136 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.194974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb89be6-36b6-430a-940f-e883d65e24ab-local-certs\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.195136 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.195042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-cacerts\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.195136 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.195089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wx5t\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-kube-api-access-7wx5t\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.195296 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.195142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-token\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.195296 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.195184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.195296 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.195235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.296277 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.296245    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.296445 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.296291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb89be6-36b6-430a-940f-e883d65e24ab-local-certs\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.296445 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.296307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-cacerts\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.296445 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.296418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wx5t\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-kube-api-access-7wx5t\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.296602 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.296471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-token\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.296602 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.296498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.296602 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.296534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.297045 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.297016    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.298727 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.298693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb89be6-36b6-430a-940f-e883d65e24ab-local-certs\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.298832 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.298762    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-cacerts\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.298892 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.298829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.298892 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.298854    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.306323 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.306302    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-token\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.306787 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.306766    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wx5t\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-kube-api-access-7wx5t\") pod \"istiod-openshift-gateway-7574459656-qt24x\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.468024 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.467995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:21.515860 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.515805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm" event={"ID":"b08023ec-5f1b-403f-a459-bff9a0e1ee71","Type":"ContainerStarted","Data":"057a472558865a7adcb916f176c8465e6b3fd8a2732a966af05314be0592f04d"}
Jul 18 03:58:21.608084 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:21.608052    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"]
Jul 18 03:58:21.610983 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:58:21.610955    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb89be6_36b6_430a_940f_e883d65e24ab.slice/crio-100fa667f61fb2c279aefdd8083802724a55ed803e1386e2b1ffe49efa9ab159 WatchSource:0}: Error finding container 100fa667f61fb2c279aefdd8083802724a55ed803e1386e2b1ffe49efa9ab159: Status 404 returned error can't find the container with id 100fa667f61fb2c279aefdd8083802724a55ed803e1386e2b1ffe49efa9ab159
Jul 18 03:58:22.522421 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:22.522377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x" event={"ID":"dbb89be6-36b6-430a-940f-e883d65e24ab","Type":"ContainerStarted","Data":"100fa667f61fb2c279aefdd8083802724a55ed803e1386e2b1ffe49efa9ab159"}
Jul 18 03:58:24.228176 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:24.228130    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 18 03:58:24.228449 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:24.228217    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 18 03:58:24.532310 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:24.532264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm" event={"ID":"b08023ec-5f1b-403f-a459-bff9a0e1ee71","Type":"ContainerStarted","Data":"8b57f4c87f58b88579daa58004252dd1bbeef011f33f7cb178a9da2674f32cca"}
Jul 18 03:58:24.533988 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:24.533965    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x" event={"ID":"dbb89be6-36b6-430a-940f-e883d65e24ab","Type":"ContainerStarted","Data":"e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c"}
Jul 18 03:58:24.534099 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:24.534044    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:24.550529 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:24.550473    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85c5cf7cfd-k8dxm" podStartSLOduration=0.960970851 podStartE2EDuration="4.550451467s" totalImagesPullingTime="3.589480616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:24.548360834 +0000 UTC m=+502.444546073" watchObservedRunningTime="2026-07-18 03:58:24.550451467 +0000 UTC m=+502.446636660"
Jul 18 03:58:24.567955 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:24.567895    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x" podStartSLOduration=0.95324305 podStartE2EDuration="3.567871274s" totalImagesPullingTime="2.614628224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:24.566540518 +0000 UTC m=+502.462725707" watchObservedRunningTime="2026-07-18 03:58:24.567871274 +0000 UTC m=+502.464056471"
Jul 18 03:58:25.540223 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:25.540189    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-qt24x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 03:58:25.540577 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:25.540236    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x" podUID="dbb89be6-36b6-430a-940f-e883d65e24ab" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 03:58:28.539611 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.539576    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:28.795878 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.795798    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"]
Jul 18 03:58:28.799156 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.799136    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:28.799283 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.799222    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"]
Jul 18 03:58:28.801215 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.801195    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 18 03:58:28.801311 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.801252    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2cn79\""
Jul 18 03:58:28.802356 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.802341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:28.804632 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.804614    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 18 03:58:28.804857 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.804736    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xl99t\""
Jul 18 03:58:28.812046 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.812024    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"]
Jul 18 03:58:28.819256 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.819230    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"]
Jul 18 03:58:28.863208 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.863173    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk5x4\" (UniqueName: \"kubernetes.io/projected/d2b46568-8ffa-41ff-8e79-5195c6291041-kube-api-access-dk5x4\") pod \"llmisvc-controller-manager-777c6bd7d5-9hswv\" (UID: \"d2b46568-8ffa-41ff-8e79-5195c6291041\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:28.863208 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.863213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2b46568-8ffa-41ff-8e79-5195c6291041-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9hswv\" (UID: \"d2b46568-8ffa-41ff-8e79-5195c6291041\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:28.863427 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.863233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdlm4\" (UniqueName: \"kubernetes.io/projected/beb33580-a505-4b26-9aba-d819a78e0e54-kube-api-access-hdlm4\") pod \"kserve-controller-manager-d6f4b65b8-p4nv6\" (UID: \"beb33580-a505-4b26-9aba-d819a78e0e54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:28.863427 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.863327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beb33580-a505-4b26-9aba-d819a78e0e54-cert\") pod \"kserve-controller-manager-d6f4b65b8-p4nv6\" (UID: \"beb33580-a505-4b26-9aba-d819a78e0e54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:28.964312 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.964272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beb33580-a505-4b26-9aba-d819a78e0e54-cert\") pod \"kserve-controller-manager-d6f4b65b8-p4nv6\" (UID: \"beb33580-a505-4b26-9aba-d819a78e0e54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:28.964491 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.964370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk5x4\" (UniqueName: \"kubernetes.io/projected/d2b46568-8ffa-41ff-8e79-5195c6291041-kube-api-access-dk5x4\") pod \"llmisvc-controller-manager-777c6bd7d5-9hswv\" (UID: \"d2b46568-8ffa-41ff-8e79-5195c6291041\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:28.964491 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.964401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2b46568-8ffa-41ff-8e79-5195c6291041-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9hswv\" (UID: \"d2b46568-8ffa-41ff-8e79-5195c6291041\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:28.964491 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.964425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdlm4\" (UniqueName: \"kubernetes.io/projected/beb33580-a505-4b26-9aba-d819a78e0e54-kube-api-access-hdlm4\") pod \"kserve-controller-manager-d6f4b65b8-p4nv6\" (UID: \"beb33580-a505-4b26-9aba-d819a78e0e54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:28.964491 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:58:28.964432    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 18 03:58:28.964722 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:58:28.964511    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beb33580-a505-4b26-9aba-d819a78e0e54-cert podName:beb33580-a505-4b26-9aba-d819a78e0e54 nodeName:}" failed. No retries permitted until 2026-07-18 03:58:29.464491894 +0000 UTC m=+507.360677081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/beb33580-a505-4b26-9aba-d819a78e0e54-cert") pod "kserve-controller-manager-d6f4b65b8-p4nv6" (UID: "beb33580-a505-4b26-9aba-d819a78e0e54") : secret "kserve-webhook-server-cert" not found
Jul 18 03:58:28.964722 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:58:28.964533    2559 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 18 03:58:28.964722 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:58:28.964606    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b46568-8ffa-41ff-8e79-5195c6291041-cert podName:d2b46568-8ffa-41ff-8e79-5195c6291041 nodeName:}" failed. No retries permitted until 2026-07-18 03:58:29.464587851 +0000 UTC m=+507.360773049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d2b46568-8ffa-41ff-8e79-5195c6291041-cert") pod "llmisvc-controller-manager-777c6bd7d5-9hswv" (UID: "d2b46568-8ffa-41ff-8e79-5195c6291041") : secret "llmisvc-webhook-server-cert" not found
Jul 18 03:58:28.975426 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.975387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk5x4\" (UniqueName: \"kubernetes.io/projected/d2b46568-8ffa-41ff-8e79-5195c6291041-kube-api-access-dk5x4\") pod \"llmisvc-controller-manager-777c6bd7d5-9hswv\" (UID: \"d2b46568-8ffa-41ff-8e79-5195c6291041\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:28.975537 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:28.975440    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdlm4\" (UniqueName: \"kubernetes.io/projected/beb33580-a505-4b26-9aba-d819a78e0e54-kube-api-access-hdlm4\") pod \"kserve-controller-manager-d6f4b65b8-p4nv6\" (UID: \"beb33580-a505-4b26-9aba-d819a78e0e54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:29.468316 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:29.468282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2b46568-8ffa-41ff-8e79-5195c6291041-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9hswv\" (UID: \"d2b46568-8ffa-41ff-8e79-5195c6291041\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:29.468485 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:29.468339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beb33580-a505-4b26-9aba-d819a78e0e54-cert\") pod \"kserve-controller-manager-d6f4b65b8-p4nv6\" (UID: \"beb33580-a505-4b26-9aba-d819a78e0e54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:29.470681 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:29.470626    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beb33580-a505-4b26-9aba-d819a78e0e54-cert\") pod \"kserve-controller-manager-d6f4b65b8-p4nv6\" (UID: \"beb33580-a505-4b26-9aba-d819a78e0e54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:29.470681 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:29.470630    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2b46568-8ffa-41ff-8e79-5195c6291041-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9hswv\" (UID: \"d2b46568-8ffa-41ff-8e79-5195c6291041\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:29.710285 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:29.710250    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:29.717611 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:29.717582    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:29.871802 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:29.871716    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"]
Jul 18 03:58:29.874143 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:58:29.874114    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb33580_a505_4b26_9aba_d819a78e0e54.slice/crio-81cc0dc5b11c53c960f79f6101c06aacc430ff3f02aa443f8325369bb03ef3e2 WatchSource:0}: Error finding container 81cc0dc5b11c53c960f79f6101c06aacc430ff3f02aa443f8325369bb03ef3e2: Status 404 returned error can't find the container with id 81cc0dc5b11c53c960f79f6101c06aacc430ff3f02aa443f8325369bb03ef3e2
Jul 18 03:58:29.890439 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:29.890417    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"]
Jul 18 03:58:29.892398 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:58:29.892365    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd2b46568_8ffa_41ff_8e79_5195c6291041.slice/crio-b41d83c9da94e3d0cd2d2d74bc65175038b22bca32640e53baa7b956f7694ebe WatchSource:0}: Error finding container b41d83c9da94e3d0cd2d2d74bc65175038b22bca32640e53baa7b956f7694ebe: Status 404 returned error can't find the container with id b41d83c9da94e3d0cd2d2d74bc65175038b22bca32640e53baa7b956f7694ebe
Jul 18 03:58:30.559710 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:30.559668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6" event={"ID":"beb33580-a505-4b26-9aba-d819a78e0e54","Type":"ContainerStarted","Data":"81cc0dc5b11c53c960f79f6101c06aacc430ff3f02aa443f8325369bb03ef3e2"}
Jul 18 03:58:30.560986 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:30.560955    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv" event={"ID":"d2b46568-8ffa-41ff-8e79-5195c6291041","Type":"ContainerStarted","Data":"b41d83c9da94e3d0cd2d2d74bc65175038b22bca32640e53baa7b956f7694ebe"}
Jul 18 03:58:32.838793 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:32.838740    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"]
Jul 18 03:58:32.839146 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:32.839015    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x" podUID="dbb89be6-36b6-430a-940f-e883d65e24ab" containerName="discovery" containerID="cri-o://e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c" gracePeriod=30
Jul 18 03:58:33.094626 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.094603    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:33.203493 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.203397    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-cacerts\") pod \"dbb89be6-36b6-430a-940f-e883d65e24ab\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") "
Jul 18 03:58:33.203493 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.203438    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb89be6-36b6-430a-940f-e883d65e24ab-local-certs\") pod \"dbb89be6-36b6-430a-940f-e883d65e24ab\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") "
Jul 18 03:58:33.203493 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.203468    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-kubeconfig\") pod \"dbb89be6-36b6-430a-940f-e883d65e24ab\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") "
Jul 18 03:58:33.203493 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.203490    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wx5t\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-kube-api-access-7wx5t\") pod \"dbb89be6-36b6-430a-940f-e883d65e24ab\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") "
Jul 18 03:58:33.203872 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.203532    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-token\") pod \"dbb89be6-36b6-430a-940f-e883d65e24ab\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") "
Jul 18 03:58:33.203872 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.203548    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-dns-cert\") pod \"dbb89be6-36b6-430a-940f-e883d65e24ab\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") "
Jul 18 03:58:33.203872 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.203574    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-ca-configmap\") pod \"dbb89be6-36b6-430a-940f-e883d65e24ab\" (UID: \"dbb89be6-36b6-430a-940f-e883d65e24ab\") "
Jul 18 03:58:33.204157 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.204128    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "dbb89be6-36b6-430a-940f-e883d65e24ab" (UID: "dbb89be6-36b6-430a-940f-e883d65e24ab"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 03:58:33.205970 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.205935    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "dbb89be6-36b6-430a-940f-e883d65e24ab" (UID: "dbb89be6-36b6-430a-940f-e883d65e24ab"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:58:33.206088 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.205932    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbb89be6-36b6-430a-940f-e883d65e24ab" (UID: "dbb89be6-36b6-430a-940f-e883d65e24ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:58:33.206088 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.206058    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb89be6-36b6-430a-940f-e883d65e24ab-local-certs" (OuterVolumeSpecName: "local-certs") pod "dbb89be6-36b6-430a-940f-e883d65e24ab" (UID: "dbb89be6-36b6-430a-940f-e883d65e24ab"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 03:58:33.206166 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.206089    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "dbb89be6-36b6-430a-940f-e883d65e24ab" (UID: "dbb89be6-36b6-430a-940f-e883d65e24ab"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:58:33.206203 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.206185    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-kube-api-access-7wx5t" (OuterVolumeSpecName: "kube-api-access-7wx5t") pod "dbb89be6-36b6-430a-940f-e883d65e24ab" (UID: "dbb89be6-36b6-430a-940f-e883d65e24ab"). InnerVolumeSpecName "kube-api-access-7wx5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:58:33.206234 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.206189    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-cacerts" (OuterVolumeSpecName: "cacerts") pod "dbb89be6-36b6-430a-940f-e883d65e24ab" (UID: "dbb89be6-36b6-430a-940f-e883d65e24ab"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 03:58:33.304613 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.304569    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-kubeconfig\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 03:58:33.304613 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.304605    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wx5t\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-kube-api-access-7wx5t\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 03:58:33.304613 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.304616    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-token\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 03:58:33.304613 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.304625    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-dns-cert\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 03:58:33.304937 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.304634    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbb89be6-36b6-430a-940f-e883d65e24ab-istio-csr-ca-configmap\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 03:58:33.304937 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.304643    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbb89be6-36b6-430a-940f-e883d65e24ab-cacerts\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 03:58:33.304937 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.304680    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbb89be6-36b6-430a-940f-e883d65e24ab-local-certs\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 03:58:33.578342 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.578299    2559 generic.go:356] "Generic (PLEG): container finished" podID="dbb89be6-36b6-430a-940f-e883d65e24ab" containerID="e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c" exitCode=0
Jul 18 03:58:33.578544 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.578369    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"
Jul 18 03:58:33.578544 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.578375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x" event={"ID":"dbb89be6-36b6-430a-940f-e883d65e24ab","Type":"ContainerDied","Data":"e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c"}
Jul 18 03:58:33.578544 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.578462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qt24x" event={"ID":"dbb89be6-36b6-430a-940f-e883d65e24ab","Type":"ContainerDied","Data":"100fa667f61fb2c279aefdd8083802724a55ed803e1386e2b1ffe49efa9ab159"}
Jul 18 03:58:33.578544 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.578496    2559 scope.go:117] "RemoveContainer" containerID="e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c"
Jul 18 03:58:33.580230 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.580204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6" event={"ID":"beb33580-a505-4b26-9aba-d819a78e0e54","Type":"ContainerStarted","Data":"64bdd3a5f3dcf1d67e58e3718de2901ab669edbb78cc465d8385e1ae552b9bc2"}
Jul 18 03:58:33.580405 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.580262    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:58:33.581761 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.581739    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv" event={"ID":"d2b46568-8ffa-41ff-8e79-5195c6291041","Type":"ContainerStarted","Data":"fa6a298084a01065dfb2426d54457998b56bc72749303044e1f0543fe463e07d"}
Jul 18 03:58:33.581897 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.581880    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:58:33.587936 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.587919    2559 scope.go:117] "RemoveContainer" containerID="e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c"
Jul 18 03:58:33.588195 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:58:33.588172    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c\": container with ID starting with e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c not found: ID does not exist" containerID="e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c"
Jul 18 03:58:33.588255 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.588207    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c"} err="failed to get container status \"e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c\": rpc error: code = NotFound desc = could not find container \"e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c\": container with ID starting with e5c07b22462f167991467fc6befb67bf9e594449467ddeb66491c58f8bb52d6c not found: ID does not exist"
Jul 18 03:58:33.597067 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.597026    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv" podStartSLOduration=2.850912123 podStartE2EDuration="5.597011755s" totalImagesPullingTime="2.746099632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:33.59590487 +0000 UTC m=+511.492090061" watchObservedRunningTime="2026-07-18 03:58:33.597011755 +0000 UTC m=+511.493196957"
Jul 18 03:58:33.614556 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.614490    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6" podStartSLOduration=2.893058552 podStartE2EDuration="5.614466068s" totalImagesPullingTime="2.721407516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:33.613332039 +0000 UTC m=+511.509517253" watchObservedRunningTime="2026-07-18 03:58:33.614466068 +0000 UTC m=+511.510651262"
Jul 18 03:58:33.626951 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.626915    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"]
Jul 18 03:58:33.630562 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:33.630513    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qt24x"]
Jul 18 03:58:34.682478 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:58:34.682443    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb89be6-36b6-430a-940f-e883d65e24ab" path="/var/lib/kubelet/pods/dbb89be6-36b6-430a-940f-e883d65e24ab/volumes"
Jul 18 03:59:04.588852 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:04.588819    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9hswv"
Jul 18 03:59:04.591838 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:04.591814    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-p4nv6"
Jul 18 03:59:19.615366 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.615328    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmfrb"]
Jul 18 03:59:19.615755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.615657    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb89be6-36b6-430a-940f-e883d65e24ab" containerName="discovery"
Jul 18 03:59:19.615755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.615670    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb89be6-36b6-430a-940f-e883d65e24ab" containerName="discovery"
Jul 18 03:59:19.615755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.615719    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb89be6-36b6-430a-940f-e883d65e24ab" containerName="discovery"
Jul 18 03:59:19.622673 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.622638    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb"
Jul 18 03:59:19.624906 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.624883    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 03:59:19.625553 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.625537    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vlsl9\""
Jul 18 03:59:19.625602 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.625557    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 03:59:19.634287 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.634232    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmfrb"]
Jul 18 03:59:19.698876 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.698835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48ttl\" (UniqueName: \"kubernetes.io/projected/1c7ba080-eb9e-4cb9-835d-8be994c1c911-kube-api-access-48ttl\") pod \"kuadrant-operator-catalog-zmfrb\" (UID: \"1c7ba080-eb9e-4cb9-835d-8be994c1c911\") " pod="kuadrant-system/kuadrant-operator-catalog-zmfrb"
Jul 18 03:59:19.800279 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.800236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48ttl\" (UniqueName: \"kubernetes.io/projected/1c7ba080-eb9e-4cb9-835d-8be994c1c911-kube-api-access-48ttl\") pod \"kuadrant-operator-catalog-zmfrb\" (UID: \"1c7ba080-eb9e-4cb9-835d-8be994c1c911\") " pod="kuadrant-system/kuadrant-operator-catalog-zmfrb"
Jul 18 03:59:19.807378 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.807347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48ttl\" (UniqueName: \"kubernetes.io/projected/1c7ba080-eb9e-4cb9-835d-8be994c1c911-kube-api-access-48ttl\") pod \"kuadrant-operator-catalog-zmfrb\" (UID: \"1c7ba080-eb9e-4cb9-835d-8be994c1c911\") " pod="kuadrant-system/kuadrant-operator-catalog-zmfrb"
Jul 18 03:59:19.938089 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:19.937990    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb"
Jul 18 03:59:20.065067 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.064911    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmfrb"]
Jul 18 03:59:20.067868 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:59:20.067835    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7ba080_eb9e_4cb9_835d_8be994c1c911.slice/crio-2e8c8c7318397285214d7e40460108215e0f3a823d659ac1bf577c4c3eed08c6 WatchSource:0}: Error finding container 2e8c8c7318397285214d7e40460108215e0f3a823d659ac1bf577c4c3eed08c6: Status 404 returned error can't find the container with id 2e8c8c7318397285214d7e40460108215e0f3a823d659ac1bf577c4c3eed08c6
Jul 18 03:59:20.227307 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.227272    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmfrb"]
Jul 18 03:59:20.243140 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.243108    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ldlg"]
Jul 18 03:59:20.245657 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.245632    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5ldlg"
Jul 18 03:59:20.253067 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.253043    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ldlg"]
Jul 18 03:59:20.304755 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.304715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptxdd\" (UniqueName: \"kubernetes.io/projected/d8011469-b034-4c90-825e-0aaccfdbe704-kube-api-access-ptxdd\") pod \"kuadrant-operator-catalog-5ldlg\" (UID: \"d8011469-b034-4c90-825e-0aaccfdbe704\") " pod="kuadrant-system/kuadrant-operator-catalog-5ldlg"
Jul 18 03:59:20.405738 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.405708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptxdd\" (UniqueName: \"kubernetes.io/projected/d8011469-b034-4c90-825e-0aaccfdbe704-kube-api-access-ptxdd\") pod \"kuadrant-operator-catalog-5ldlg\" (UID: \"d8011469-b034-4c90-825e-0aaccfdbe704\") " pod="kuadrant-system/kuadrant-operator-catalog-5ldlg"
Jul 18 03:59:20.413384 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.413354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptxdd\" (UniqueName: \"kubernetes.io/projected/d8011469-b034-4c90-825e-0aaccfdbe704-kube-api-access-ptxdd\") pod \"kuadrant-operator-catalog-5ldlg\" (UID: \"d8011469-b034-4c90-825e-0aaccfdbe704\") " pod="kuadrant-system/kuadrant-operator-catalog-5ldlg"
Jul 18 03:59:20.556262 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.556178    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5ldlg"
Jul 18 03:59:20.769050 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.769019    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ldlg"]
Jul 18 03:59:20.776489 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:20.776458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb" event={"ID":"1c7ba080-eb9e-4cb9-835d-8be994c1c911","Type":"ContainerStarted","Data":"2e8c8c7318397285214d7e40460108215e0f3a823d659ac1bf577c4c3eed08c6"}
Jul 18 03:59:20.780271 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:59:20.780247    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8011469_b034_4c90_825e_0aaccfdbe704.slice/crio-56ce3d77732acb6a3233b84c150f09cbeaa2a38d8c3dd4950b092f916407158f WatchSource:0}: Error finding container 56ce3d77732acb6a3233b84c150f09cbeaa2a38d8c3dd4950b092f916407158f: Status 404 returned error can't find the container with id 56ce3d77732acb6a3233b84c150f09cbeaa2a38d8c3dd4950b092f916407158f
Jul 18 03:59:21.783935 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:21.783891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5ldlg" event={"ID":"d8011469-b034-4c90-825e-0aaccfdbe704","Type":"ContainerStarted","Data":"56ce3d77732acb6a3233b84c150f09cbeaa2a38d8c3dd4950b092f916407158f"}
Jul 18 03:59:22.789718 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:22.789674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb" event={"ID":"1c7ba080-eb9e-4cb9-835d-8be994c1c911","Type":"ContainerStarted","Data":"72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f"}
Jul 18 03:59:22.790153 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:22.789767    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb" podUID="1c7ba080-eb9e-4cb9-835d-8be994c1c911" containerName="registry-server" containerID="cri-o://72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f" gracePeriod=2
Jul 18 03:59:22.791230 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:22.791205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5ldlg" event={"ID":"d8011469-b034-4c90-825e-0aaccfdbe704","Type":"ContainerStarted","Data":"1cefc2b169e33feb1cdd1b0c0c0af425ea1d20d8ef9a208bc87ec9bf79e8a430"}
Jul 18 03:59:22.802993 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:22.802948    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb" podStartSLOduration=1.702770933 podStartE2EDuration="3.802934297s" totalImagesPullingTime="2.100163364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:59:22.801616297 +0000 UTC m=+560.697801488" watchObservedRunningTime="2026-07-18 03:59:22.802934297 +0000 UTC m=+560.699119488"
Jul 18 03:59:23.026008 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.025983    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb"
Jul 18 03:59:23.040024 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.039930    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5ldlg" podStartSLOduration=1.649238969 podStartE2EDuration="3.039913818s" totalImagesPullingTime="1.390674849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:59:22.814604917 +0000 UTC m=+560.710790107" watchObservedRunningTime="2026-07-18 03:59:23.039913818 +0000 UTC m=+560.936099008"
Jul 18 03:59:23.130328 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.130294    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48ttl\" (UniqueName: \"kubernetes.io/projected/1c7ba080-eb9e-4cb9-835d-8be994c1c911-kube-api-access-48ttl\") pod \"1c7ba080-eb9e-4cb9-835d-8be994c1c911\" (UID: \"1c7ba080-eb9e-4cb9-835d-8be994c1c911\") "
Jul 18 03:59:23.132465 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.132439    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c7ba080-eb9e-4cb9-835d-8be994c1c911-kube-api-access-48ttl" (OuterVolumeSpecName: "kube-api-access-48ttl") pod "1c7ba080-eb9e-4cb9-835d-8be994c1c911" (UID: "1c7ba080-eb9e-4cb9-835d-8be994c1c911"). InnerVolumeSpecName "kube-api-access-48ttl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 03:59:23.231085 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.231045    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48ttl\" (UniqueName: \"kubernetes.io/projected/1c7ba080-eb9e-4cb9-835d-8be994c1c911-kube-api-access-48ttl\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 03:59:23.796594 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.796561    2559 generic.go:356] "Generic (PLEG): container finished" podID="1c7ba080-eb9e-4cb9-835d-8be994c1c911" containerID="72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f" exitCode=0
Jul 18 03:59:23.797093 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.796608    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb"
Jul 18 03:59:23.797093 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.796662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb" event={"ID":"1c7ba080-eb9e-4cb9-835d-8be994c1c911","Type":"ContainerDied","Data":"72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f"}
Jul 18 03:59:23.797093 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.796715    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zmfrb" event={"ID":"1c7ba080-eb9e-4cb9-835d-8be994c1c911","Type":"ContainerDied","Data":"2e8c8c7318397285214d7e40460108215e0f3a823d659ac1bf577c4c3eed08c6"}
Jul 18 03:59:23.797093 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.796738    2559 scope.go:117] "RemoveContainer" containerID="72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f"
Jul 18 03:59:23.805425 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.805404    2559 scope.go:117] "RemoveContainer" containerID="72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f"
Jul 18 03:59:23.805732 ip-10-0-130-148 kubenswrapper[2559]: E0718 03:59:23.805710    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f\": container with ID starting with 72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f not found: ID does not exist" containerID="72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f"
Jul 18 03:59:23.805828 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.805739    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f"} err="failed to get container status \"72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f\": rpc error: code = NotFound desc = could not find container \"72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f\": container with ID starting with 72d9aafc51191d3463de8b4a111fb59387598d331f90ade0be7fab08facd6f9f not found: ID does not exist"
Jul 18 03:59:23.815364 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.815339    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmfrb"]
Jul 18 03:59:23.818886 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:23.818864    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zmfrb"]
Jul 18 03:59:24.682462 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:24.682429    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c7ba080-eb9e-4cb9-835d-8be994c1c911" path="/var/lib/kubelet/pods/1c7ba080-eb9e-4cb9-835d-8be994c1c911/volumes"
Jul 18 03:59:30.556970 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:30.556930    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5ldlg"
Jul 18 03:59:30.557380 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:30.556991    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5ldlg"
Jul 18 03:59:30.579904 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:30.579874    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5ldlg"
Jul 18 03:59:30.845691 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:30.845601    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5ldlg"
Jul 18 03:59:51.031052 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.031015    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"]
Jul 18 03:59:51.031588 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.031476    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c7ba080-eb9e-4cb9-835d-8be994c1c911" containerName="registry-server"
Jul 18 03:59:51.031588 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.031495    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7ba080-eb9e-4cb9-835d-8be994c1c911" containerName="registry-server"
Jul 18 03:59:51.031588 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.031572    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c7ba080-eb9e-4cb9-835d-8be994c1c911" containerName="registry-server"
Jul 18 03:59:51.039509 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.039481    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"
Jul 18 03:59:51.042895 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.042872    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j7fzz\""
Jul 18 03:59:51.043013 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.042947    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 18 03:59:51.047485 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.047456    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"]
Jul 18 03:59:51.173713 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.173631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fslfw\" (UniqueName: \"kubernetes.io/projected/5834ac67-128f-4fd6-86b3-f49a5e434e66-kube-api-access-fslfw\") pod \"dns-operator-controller-manager-864dd78c4c-tsn6d\" (UID: \"5834ac67-128f-4fd6-86b3-f49a5e434e66\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"
Jul 18 03:59:51.274308 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.274265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fslfw\" (UniqueName: \"kubernetes.io/projected/5834ac67-128f-4fd6-86b3-f49a5e434e66-kube-api-access-fslfw\") pod \"dns-operator-controller-manager-864dd78c4c-tsn6d\" (UID: \"5834ac67-128f-4fd6-86b3-f49a5e434e66\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"
Jul 18 03:59:51.284737 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.284659    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fslfw\" (UniqueName: \"kubernetes.io/projected/5834ac67-128f-4fd6-86b3-f49a5e434e66-kube-api-access-fslfw\") pod \"dns-operator-controller-manager-864dd78c4c-tsn6d\" (UID: \"5834ac67-128f-4fd6-86b3-f49a5e434e66\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"
Jul 18 03:59:51.352485 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.352426    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"
Jul 18 03:59:51.495496 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.495468    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"]
Jul 18 03:59:51.498160 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:59:51.498134    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5834ac67_128f_4fd6_86b3_f49a5e434e66.slice/crio-3f0485f9d11c260c89a19c7334c0f66dfabdad38cb524d37b73ce1b747224d6f WatchSource:0}: Error finding container 3f0485f9d11c260c89a19c7334c0f66dfabdad38cb524d37b73ce1b747224d6f: Status 404 returned error can't find the container with id 3f0485f9d11c260c89a19c7334c0f66dfabdad38cb524d37b73ce1b747224d6f
Jul 18 03:59:51.927105 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:51.927066    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d" event={"ID":"5834ac67-128f-4fd6-86b3-f49a5e434e66","Type":"ContainerStarted","Data":"3f0485f9d11c260c89a19c7334c0f66dfabdad38cb524d37b73ce1b747224d6f"}
Jul 18 03:59:53.938028 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:53.937932    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d" event={"ID":"5834ac67-128f-4fd6-86b3-f49a5e434e66","Type":"ContainerStarted","Data":"ec7a508d47b098a65aae224960894d17d13b8e8e8f581e342a02176ada541fab"}
Jul 18 03:59:53.938427 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:53.938069    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"
Jul 18 03:59:53.952351 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:53.952305    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d" podStartSLOduration=0.95382546 podStartE2EDuration="2.952289279s" totalImagesPullingTime="1.998463819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:59:53.952039734 +0000 UTC m=+591.848224925" watchObservedRunningTime="2026-07-18 03:59:53.952289279 +0000 UTC m=+591.848474469"
Jul 18 03:59:54.504094 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:54.504059    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"]
Jul 18 03:59:54.507319 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:54.507303    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 03:59:54.509304 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:54.509286    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6xslt\""
Jul 18 03:59:54.515372 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:54.515349    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"]
Jul 18 03:59:54.601561 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:54.601519    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47bxr\" (UniqueName: \"kubernetes.io/projected/da801f8c-cb46-4cd2-a68e-d22a4794c9d9-kube-api-access-47bxr\") pod \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" (UID: \"da801f8c-cb46-4cd2-a68e-d22a4794c9d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 03:59:54.702447 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:54.702410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47bxr\" (UniqueName: \"kubernetes.io/projected/da801f8c-cb46-4cd2-a68e-d22a4794c9d9-kube-api-access-47bxr\") pod \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" (UID: \"da801f8c-cb46-4cd2-a68e-d22a4794c9d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 03:59:54.714193 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:54.714152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47bxr\" (UniqueName: \"kubernetes.io/projected/da801f8c-cb46-4cd2-a68e-d22a4794c9d9-kube-api-access-47bxr\") pod \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" (UID: \"da801f8c-cb46-4cd2-a68e-d22a4794c9d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 03:59:54.818345 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:54.818255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 03:59:54.955170 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:54.955136    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"]
Jul 18 03:59:54.958277 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:59:54.958247    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda801f8c_cb46_4cd2_a68e_d22a4794c9d9.slice/crio-b2de9b75c7ecb15842fe368e07a900fa5f80149037bbf783162be05dbcd6bb01 WatchSource:0}: Error finding container b2de9b75c7ecb15842fe368e07a900fa5f80149037bbf783162be05dbcd6bb01: Status 404 returned error can't find the container with id b2de9b75c7ecb15842fe368e07a900fa5f80149037bbf783162be05dbcd6bb01
Jul 18 03:59:55.949204 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:55.949165    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l" event={"ID":"da801f8c-cb46-4cd2-a68e-d22a4794c9d9","Type":"ContainerStarted","Data":"b2de9b75c7ecb15842fe368e07a900fa5f80149037bbf783162be05dbcd6bb01"}
Jul 18 03:59:56.954859 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:56.954820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l" event={"ID":"da801f8c-cb46-4cd2-a68e-d22a4794c9d9","Type":"ContainerStarted","Data":"0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37"}
Jul 18 03:59:56.955354 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:56.954943    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 03:59:56.972454 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:56.972400    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l" podStartSLOduration=1.623940623 podStartE2EDuration="2.972383629s" totalImagesPullingTime="1.348443006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:59:56.971488353 +0000 UTC m=+594.867673565" watchObservedRunningTime="2026-07-18 03:59:56.972383629 +0000 UTC m=+594.868568820"
Jul 18 03:59:58.520417 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:58.520382    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"]
Jul 18 03:59:58.523693 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:58.523676    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"
Jul 18 03:59:58.527274 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:58.527253    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vsxmw\""
Jul 18 03:59:58.536595 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:58.536572    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8snp\" (UniqueName: \"kubernetes.io/projected/41c37bd6-1e50-4c4a-84dd-7e487bc180ee-kube-api-access-w8snp\") pod \"authorino-operator-75cc8d5cb7-shvk5\" (UID: \"41c37bd6-1e50-4c4a-84dd-7e487bc180ee\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"
Jul 18 03:59:58.551860 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:58.551831    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"]
Jul 18 03:59:58.637531 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:58.637489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8snp\" (UniqueName: \"kubernetes.io/projected/41c37bd6-1e50-4c4a-84dd-7e487bc180ee-kube-api-access-w8snp\") pod \"authorino-operator-75cc8d5cb7-shvk5\" (UID: \"41c37bd6-1e50-4c4a-84dd-7e487bc180ee\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"
Jul 18 03:59:58.644988 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:58.644963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8snp\" (UniqueName: \"kubernetes.io/projected/41c37bd6-1e50-4c4a-84dd-7e487bc180ee-kube-api-access-w8snp\") pod \"authorino-operator-75cc8d5cb7-shvk5\" (UID: \"41c37bd6-1e50-4c4a-84dd-7e487bc180ee\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"
Jul 18 03:59:58.833622 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:58.833535    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"
Jul 18 03:59:58.969274 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:58.969108    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"]
Jul 18 03:59:58.972045 ip-10-0-130-148 kubenswrapper[2559]: W0718 03:59:58.972020    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c37bd6_1e50_4c4a_84dd_7e487bc180ee.slice/crio-5cc37f613dfb11df55101596f9e7f82568cfd4f38fd645fb5d93f5c7f2444cf3 WatchSource:0}: Error finding container 5cc37f613dfb11df55101596f9e7f82568cfd4f38fd645fb5d93f5c7f2444cf3: Status 404 returned error can't find the container with id 5cc37f613dfb11df55101596f9e7f82568cfd4f38fd645fb5d93f5c7f2444cf3
Jul 18 03:59:59.970027 ip-10-0-130-148 kubenswrapper[2559]: I0718 03:59:59.969989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5" event={"ID":"41c37bd6-1e50-4c4a-84dd-7e487bc180ee","Type":"ContainerStarted","Data":"5cc37f613dfb11df55101596f9e7f82568cfd4f38fd645fb5d93f5c7f2444cf3"}
Jul 18 04:00:01.980733 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:01.980694    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5" event={"ID":"41c37bd6-1e50-4c4a-84dd-7e487bc180ee","Type":"ContainerStarted","Data":"7d335e3b2e6ceb148231fba9bb77d59253aa0bbfdf99fb5e1fefce7b7a094747"}
Jul 18 04:00:01.981154 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:01.980780    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"
Jul 18 04:00:01.995446 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:01.995381    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5" podStartSLOduration=1.969960107 podStartE2EDuration="3.99536044s" totalImagesPullingTime="2.025400333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:00:01.995250184 +0000 UTC m=+599.891435403" watchObservedRunningTime="2026-07-18 04:00:01.99536044 +0000 UTC m=+599.891545631"
Jul 18 04:00:02.913136 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:02.913014    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"]
Jul 18 04:00:02.926625 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:02.918731    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:02.926625 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:02.920863    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4d7pk\""
Jul 18 04:00:02.926625 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:02.925963    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"]
Jul 18 04:00:02.978148 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:02.978119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" (UID: \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:02.978332 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:02.978161    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvpqp\" (UniqueName: \"kubernetes.io/projected/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-kube-api-access-tvpqp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" (UID: \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:03.078924 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:03.078886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" (UID: \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:03.078924 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:03.078933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvpqp\" (UniqueName: \"kubernetes.io/projected/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-kube-api-access-tvpqp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" (UID: \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:03.079438 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:03.079317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" (UID: \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:03.087286 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:03.087256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvpqp\" (UniqueName: \"kubernetes.io/projected/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-kube-api-access-tvpqp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" (UID: \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:03.230218 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:03.230187    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:03.387721 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:03.387677    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"]
Jul 18 04:00:03.393496 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:00:03.393464    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9cb809_7f7b_44d7_b06b_7f0467bed4c7.slice/crio-a3704f7c27d4a4c751004965055a1c3c45efccde23f49355f40594331000be62 WatchSource:0}: Error finding container a3704f7c27d4a4c751004965055a1c3c45efccde23f49355f40594331000be62: Status 404 returned error can't find the container with id a3704f7c27d4a4c751004965055a1c3c45efccde23f49355f40594331000be62
Jul 18 04:00:03.990501 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:03.990464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn" event={"ID":"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7","Type":"ContainerStarted","Data":"a3704f7c27d4a4c751004965055a1c3c45efccde23f49355f40594331000be62"}
Jul 18 04:00:04.945437 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:04.945406    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tsn6d"
Jul 18 04:00:07.962027 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:07.961991    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:09.018855 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:09.018816    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn" event={"ID":"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7","Type":"ContainerStarted","Data":"dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f"}
Jul 18 04:00:09.019246 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:09.018940    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:09.035818 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:09.035763    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn" podStartSLOduration=2.061668906 podStartE2EDuration="7.035737015s" totalImagesPullingTime="4.974068109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:00:09.034193938 +0000 UTC m=+606.930379155" watchObservedRunningTime="2026-07-18 04:00:09.035737015 +0000 UTC m=+606.931922209"
Jul 18 04:00:12.987196 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:12.987164    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-shvk5"
Jul 18 04:00:20.026743 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:20.026710    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:20.846778 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:20.846743    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"]
Jul 18 04:00:20.850266 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:20.850246    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:20.861427 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:20.861397    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"]
Jul 18 04:00:20.945796 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:20.945758    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29bn8\" (UniqueName: \"kubernetes.io/projected/149b7a39-ad34-403c-84fc-dc8a6bb900e7-kube-api-access-29bn8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" (UID: \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:20.945974 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:20.945831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/149b7a39-ad34-403c-84fc-dc8a6bb900e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" (UID: \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:21.046677 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.046622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/149b7a39-ad34-403c-84fc-dc8a6bb900e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" (UID: \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:21.047107 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.046722    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29bn8\" (UniqueName: \"kubernetes.io/projected/149b7a39-ad34-403c-84fc-dc8a6bb900e7-kube-api-access-29bn8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" (UID: \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:21.047107 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.047058    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/149b7a39-ad34-403c-84fc-dc8a6bb900e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" (UID: \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:21.060569 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.060540    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29bn8\" (UniqueName: \"kubernetes.io/projected/149b7a39-ad34-403c-84fc-dc8a6bb900e7-kube-api-access-29bn8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" (UID: \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:21.160718 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.160598    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:21.295021 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.294984    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"]
Jul 18 04:00:21.298600 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:00:21.298571    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149b7a39_ad34_403c_84fc_dc8a6bb900e7.slice/crio-fc1bde5936ee5e2c0b4bb276f04666e453a792f27f66b18f755baef3da4da400 WatchSource:0}: Error finding container fc1bde5936ee5e2c0b4bb276f04666e453a792f27f66b18f755baef3da4da400: Status 404 returned error can't find the container with id fc1bde5936ee5e2c0b4bb276f04666e453a792f27f66b18f755baef3da4da400
Jul 18 04:00:21.629911 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.629879    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"]
Jul 18 04:00:21.633508 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.633480    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"]
Jul 18 04:00:21.643030 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.642999    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"]
Jul 18 04:00:21.643204 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.643183    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" containerName="manager" containerID="cri-o://dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f" gracePeriod=2
Jul 18 04:00:21.650768 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.650700    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"]
Jul 18 04:00:21.657055 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.656903    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\": pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:21.663488 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.663450    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"]
Jul 18 04:00:21.663921 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.663851    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" containerName="manager" containerID="cri-o://0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37" gracePeriod=2
Jul 18 04:00:21.670274 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.670148    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"]
Jul 18 04:00:21.671106 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.671008    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" containerName="manager"
Jul 18 04:00:21.671106 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.671035    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" containerName="manager"
Jul 18 04:00:21.671106 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.671059    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" containerName="manager"
Jul 18 04:00:21.671106 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.671068    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" containerName="manager"
Jul 18 04:00:21.671541 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.671160    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" containerName="manager"
Jul 18 04:00:21.671541 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.671170    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" containerName="manager"
Jul 18 04:00:21.674194 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.674166    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"]
Jul 18 04:00:21.674324 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.674283    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:21.675426 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.675394    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:21.677763 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.677700    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:21.679448 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.679418    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:21.687935 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.687895    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"]
Jul 18 04:00:21.689973 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.689947    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"]
Jul 18 04:00:21.690452 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.690432    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" containerName="manager"
Jul 18 04:00:21.690529 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.690456    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" containerName="manager"
Jul 18 04:00:21.690582 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.690554    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" containerName="manager"
Jul 18 04:00:21.693760 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.693736    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"
Jul 18 04:00:21.699919 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.699896    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"]
Jul 18 04:00:21.703262 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.703231    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:21.719404 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.719343    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:21.751505 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.751467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw86l\" (UniqueName: \"kubernetes.io/projected/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-kube-api-access-fw86l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w599s\" (UID: \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:21.751674 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.751518    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w599s\" (UID: \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:21.852307 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.852261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w599s\" (UID: \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:21.852515 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.852390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v5bb\" (UniqueName: \"kubernetes.io/projected/5fb31e58-68d2-4fab-bb5f-bf5f05a0285b-kube-api-access-9v5bb\") pod \"limitador-operator-controller-manager-859d7b78bd-n7wvl\" (UID: \"5fb31e58-68d2-4fab-bb5f-bf5f05a0285b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"
Jul 18 04:00:21.852515 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.852434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw86l\" (UniqueName: \"kubernetes.io/projected/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-kube-api-access-fw86l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w599s\" (UID: \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:21.852723 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.852699    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w599s\" (UID: \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:21.864811 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.864778    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw86l\" (UniqueName: \"kubernetes.io/projected/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-kube-api-access-fw86l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w599s\" (UID: \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:21.893462 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.893438    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:21.895475 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.895446    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:21.896943 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.896911    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:21.899049 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.899030    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:21.901241 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.901218    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:21.902783 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:21.902763    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:21.953522 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.953489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v5bb\" (UniqueName: \"kubernetes.io/projected/5fb31e58-68d2-4fab-bb5f-bf5f05a0285b-kube-api-access-9v5bb\") pod \"limitador-operator-controller-manager-859d7b78bd-n7wvl\" (UID: \"5fb31e58-68d2-4fab-bb5f-bf5f05a0285b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"
Jul 18 04:00:21.962314 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:21.962287    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v5bb\" (UniqueName: \"kubernetes.io/projected/5fb31e58-68d2-4fab-bb5f-bf5f05a0285b-kube-api-access-9v5bb\") pod \"limitador-operator-controller-manager-859d7b78bd-n7wvl\" (UID: \"5fb31e58-68d2-4fab-bb5f-bf5f05a0285b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"
Jul 18 04:00:22.054198 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.054161    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-extensions-socket-volume\") pod \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\" (UID: \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\") "
Jul 18 04:00:22.054198 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.054204    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47bxr\" (UniqueName: \"kubernetes.io/projected/da801f8c-cb46-4cd2-a68e-d22a4794c9d9-kube-api-access-47bxr\") pod \"da801f8c-cb46-4cd2-a68e-d22a4794c9d9\" (UID: \"da801f8c-cb46-4cd2-a68e-d22a4794c9d9\") "
Jul 18 04:00:22.054764 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.054254    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvpqp\" (UniqueName: \"kubernetes.io/projected/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-kube-api-access-tvpqp\") pod \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\" (UID: \"ad9cb809-7f7b-44d7-b06b-7f0467bed4c7\") "
Jul 18 04:00:22.054850 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.054820    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" (UID: "ad9cb809-7f7b-44d7-b06b-7f0467bed4c7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 04:00:22.056296 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.056274    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-kube-api-access-tvpqp" (OuterVolumeSpecName: "kube-api-access-tvpqp") pod "ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" (UID: "ad9cb809-7f7b-44d7-b06b-7f0467bed4c7"). InnerVolumeSpecName "kube-api-access-tvpqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 04:00:22.056348 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.056307    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da801f8c-cb46-4cd2-a68e-d22a4794c9d9-kube-api-access-47bxr" (OuterVolumeSpecName: "kube-api-access-47bxr") pod "da801f8c-cb46-4cd2-a68e-d22a4794c9d9" (UID: "da801f8c-cb46-4cd2-a68e-d22a4794c9d9"). InnerVolumeSpecName "kube-api-access-47bxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 04:00:22.064431 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.064407    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:22.070549 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.070524    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"
Jul 18 04:00:22.079142 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.079109    2559 generic.go:356] "Generic (PLEG): container finished" podID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" containerID="0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37" exitCode=0
Jul 18 04:00:22.079264 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.079170    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:22.079264 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.079220    2559 scope.go:117] "RemoveContainer" containerID="0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37"
Jul 18 04:00:22.081291 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.081256    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:22.081413 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.081343    2559 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq" container="manager"
Jul 18 04:00:22.083117 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.082941    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:22.083233 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.083207    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" containerID="dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f" exitCode=0
Jul 18 04:00:22.083368 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.083301    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:22.091714 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.091624    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:22.093965 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.093600    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:22.095488 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.095460    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:22.097211 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.097179    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:22.098972 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.098944    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:22.099293 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.099270    2559 scope.go:117] "RemoveContainer" containerID="0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37"
Jul 18 04:00:22.099861 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.099835    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37\": container with ID starting with 0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37 not found: ID does not exist" containerID="0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37"
Jul 18 04:00:22.099969 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.099874    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37"} err="failed to get container status \"0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37\": rpc error: code = NotFound desc = could not find container \"0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37\": container with ID starting with 0e9fbed02f08af0866e429523a0cdb8bcd9ac1a07a1d2537c498dd5c9c479e37 not found: ID does not exist"
Jul 18 04:00:22.099969 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.099909    2559 scope.go:117] "RemoveContainer" containerID="dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f"
Jul 18 04:00:22.100788 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.100731    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:22.102795 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.102763    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:22.104489 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.104462    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:22.106237 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.106189    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:22.108034 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.107912    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:22.109437 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.109407    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:22.110289 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.110274    2559 scope.go:117] "RemoveContainer" containerID="dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f"
Jul 18 04:00:22.110633 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.110611    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f\": container with ID starting with dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f not found: ID does not exist" containerID="dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f"
Jul 18 04:00:22.110705 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.110659    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f"} err="failed to get container status \"dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f\": rpc error: code = NotFound desc = could not find container \"dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f\": container with ID starting with dc823242e9a3316786b4905c3b8e0b3c285b342f15330de8aca8d970276e938f not found: ID does not exist"
Jul 18 04:00:22.111201 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.111181    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:22.155352 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.155308    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvpqp\" (UniqueName: \"kubernetes.io/projected/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-kube-api-access-tvpqp\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:00:22.155500 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.155362    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7-extensions-socket-volume\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:00:22.155500 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.155377    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47bxr\" (UniqueName: \"kubernetes.io/projected/da801f8c-cb46-4cd2-a68e-d22a4794c9d9-kube-api-access-47bxr\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:00:22.221683 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.221416    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"]
Jul 18 04:00:22.227856 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:00:22.227814    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef9a2d1_bbb1_4a63_a312_7ca2d9f3d998.slice/crio-f0f76f21909f29f5e774cec24d5015a8efcff86f0bb01bacc474313dccf36e41 WatchSource:0}: Error finding container f0f76f21909f29f5e774cec24d5015a8efcff86f0bb01bacc474313dccf36e41: Status 404 returned error can't find the container with id f0f76f21909f29f5e774cec24d5015a8efcff86f0bb01bacc474313dccf36e41
Jul 18 04:00:22.241105 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.241080    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"]
Jul 18 04:00:22.244503 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:00:22.244477    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb31e58_68d2_4fab_bb5f_bf5f05a0285b.slice/crio-68c6c538e6c7d65b87bd6040d655cd442cebbe35921894525fae5f7531ba7f57 WatchSource:0}: Error finding container 68c6c538e6c7d65b87bd6040d655cd442cebbe35921894525fae5f7531ba7f57: Status 404 returned error can't find the container with id 68c6c538e6c7d65b87bd6040d655cd442cebbe35921894525fae5f7531ba7f57
Jul 18 04:00:22.680994 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.680953    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vqz8l\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vqz8l"
Jul 18 04:00:22.682480 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.682452    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8r2jn\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8r2jn"
Jul 18 04:00:22.684024 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:22.683996    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:22.684564 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.684544    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad9cb809-7f7b-44d7-b06b-7f0467bed4c7" path="/var/lib/kubelet/pods/ad9cb809-7f7b-44d7-b06b-7f0467bed4c7/volumes"
Jul 18 04:00:22.684895 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:22.684881    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da801f8c-cb46-4cd2-a68e-d22a4794c9d9" path="/var/lib/kubelet/pods/da801f8c-cb46-4cd2-a68e-d22a4794c9d9/volumes"
Jul 18 04:00:23.091040 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.090989    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" containerName="manager" containerID="cri-o://d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e" gracePeriod=2
Jul 18 04:00:23.092973 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.092944    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s" event={"ID":"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998","Type":"ContainerStarted","Data":"f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46"}
Jul 18 04:00:23.093089 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.093003    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s" event={"ID":"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998","Type":"ContainerStarted","Data":"f0f76f21909f29f5e774cec24d5015a8efcff86f0bb01bacc474313dccf36e41"}
Jul 18 04:00:23.093089 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.093072    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:23.095731 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.095699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl" event={"ID":"5fb31e58-68d2-4fab-bb5f-bf5f05a0285b","Type":"ContainerStarted","Data":"1a25afbe907c7b83b3d6fba2b04b1b7ce9a96c51731ae1aaf815df1795127ca4"}
Jul 18 04:00:23.095931 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.095909    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"
Jul 18 04:00:23.096017 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.095947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl" event={"ID":"5fb31e58-68d2-4fab-bb5f-bf5f05a0285b","Type":"ContainerStarted","Data":"68c6c538e6c7d65b87bd6040d655cd442cebbe35921894525fae5f7531ba7f57"}
Jul 18 04:00:23.141577 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.141515    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s" podStartSLOduration=2.141498603 podStartE2EDuration="2.141498603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:00:23.141092113 +0000 UTC m=+621.037277305" watchObservedRunningTime="2026-07-18 04:00:23.141498603 +0000 UTC m=+621.037683794"
Jul 18 04:00:23.181784 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.181725    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl" podStartSLOduration=2.181706873 podStartE2EDuration="2.181706873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:00:23.180112141 +0000 UTC m=+621.076297332" watchObservedRunningTime="2026-07-18 04:00:23.181706873 +0000 UTC m=+621.077892063"
Jul 18 04:00:23.342820 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.342756    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:23.344628 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:23.344601    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:23.466719 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.466685    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29bn8\" (UniqueName: \"kubernetes.io/projected/149b7a39-ad34-403c-84fc-dc8a6bb900e7-kube-api-access-29bn8\") pod \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\" (UID: \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\") "
Jul 18 04:00:23.466885 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.466746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/149b7a39-ad34-403c-84fc-dc8a6bb900e7-extensions-socket-volume\") pod \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\" (UID: \"149b7a39-ad34-403c-84fc-dc8a6bb900e7\") "
Jul 18 04:00:23.467106 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.467083    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/149b7a39-ad34-403c-84fc-dc8a6bb900e7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "149b7a39-ad34-403c-84fc-dc8a6bb900e7" (UID: "149b7a39-ad34-403c-84fc-dc8a6bb900e7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 04:00:23.468827 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.468798    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/149b7a39-ad34-403c-84fc-dc8a6bb900e7-kube-api-access-29bn8" (OuterVolumeSpecName: "kube-api-access-29bn8") pod "149b7a39-ad34-403c-84fc-dc8a6bb900e7" (UID: "149b7a39-ad34-403c-84fc-dc8a6bb900e7"). InnerVolumeSpecName "kube-api-access-29bn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 04:00:23.567349 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.567310    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/149b7a39-ad34-403c-84fc-dc8a6bb900e7-extensions-socket-volume\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:00:23.567349 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:23.567342    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29bn8\" (UniqueName: \"kubernetes.io/projected/149b7a39-ad34-403c-84fc-dc8a6bb900e7-kube-api-access-29bn8\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:00:24.101882 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:24.101846    2559 generic.go:356] "Generic (PLEG): container finished" podID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" containerID="d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e" exitCode=0
Jul 18 04:00:24.102302 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:24.101891    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:24.102302 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:24.101951    2559 scope.go:117] "RemoveContainer" containerID="d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e"
Jul 18 04:00:24.103979 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:24.103943    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:24.110940 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:24.110923    2559 scope.go:117] "RemoveContainer" containerID="d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e"
Jul 18 04:00:24.111212 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:24.111192    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e\": container with ID starting with d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e not found: ID does not exist" containerID="d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e"
Jul 18 04:00:24.111261 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:24.111221    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e"} err="failed to get container status \"d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e\": rpc error: code = NotFound desc = could not find container \"d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e\": container with ID starting with d70dd1e26aedbb3a2a7df9b73f3320d322609ee9f333d4c30f9b177129c00e4e not found: ID does not exist"
Jul 18 04:00:24.112310 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:24.112286    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-jztzq\" is forbidden: User \"system:node:ip-10-0-130-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-148.ec2.internal' and this object" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-jztzq"
Jul 18 04:00:24.683280 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:24.683235    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="149b7a39-ad34-403c-84fc-dc8a6bb900e7" path="/var/lib/kubelet/pods/149b7a39-ad34-403c-84fc-dc8a6bb900e7/volumes"
Jul 18 04:00:34.104191 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:34.104160    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:34.104760 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:34.104356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7wvl"
Jul 18 04:00:49.602102 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.602064    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"]
Jul 18 04:00:49.602605 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.602352    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s" podUID="7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998" containerName="manager" containerID="cri-o://f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46" gracePeriod=10
Jul 18 04:00:49.803844 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.803811    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"]
Jul 18 04:00:49.806146 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.806128    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:00:49.822216 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.822186    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"]
Jul 18 04:00:49.854121 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.854059    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:49.877804 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.877777    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-extensions-socket-volume\") pod \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\" (UID: \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\") "
Jul 18 04:00:49.877970 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.877820    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw86l\" (UniqueName: \"kubernetes.io/projected/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-kube-api-access-fw86l\") pod \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\" (UID: \"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998\") "
Jul 18 04:00:49.877970 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.877909    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr5l6\" (UniqueName: \"kubernetes.io/projected/d63f9df6-b6f8-4181-b74b-332d89d20d5d-kube-api-access-vr5l6\") pod \"kuadrant-operator-controller-manager-86878c769f-lflmf\" (UID: \"d63f9df6-b6f8-4181-b74b-332d89d20d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:00:49.878072 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.877981    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d63f9df6-b6f8-4181-b74b-332d89d20d5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lflmf\" (UID: \"d63f9df6-b6f8-4181-b74b-332d89d20d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:00:49.878182 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.878158    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998" (UID: "7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 04:00:49.879943 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.879908    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-kube-api-access-fw86l" (OuterVolumeSpecName: "kube-api-access-fw86l") pod "7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998" (UID: "7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998"). InnerVolumeSpecName "kube-api-access-fw86l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 04:00:49.979260 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.979223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d63f9df6-b6f8-4181-b74b-332d89d20d5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lflmf\" (UID: \"d63f9df6-b6f8-4181-b74b-332d89d20d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:00:49.979432 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.979311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr5l6\" (UniqueName: \"kubernetes.io/projected/d63f9df6-b6f8-4181-b74b-332d89d20d5d-kube-api-access-vr5l6\") pod \"kuadrant-operator-controller-manager-86878c769f-lflmf\" (UID: \"d63f9df6-b6f8-4181-b74b-332d89d20d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:00:49.979432 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.979347    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-extensions-socket-volume\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:00:49.979432 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.979359    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw86l\" (UniqueName: \"kubernetes.io/projected/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998-kube-api-access-fw86l\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:00:49.979606 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.979584    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d63f9df6-b6f8-4181-b74b-332d89d20d5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lflmf\" (UID: \"d63f9df6-b6f8-4181-b74b-332d89d20d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:00:49.997754 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:49.997727    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr5l6\" (UniqueName: \"kubernetes.io/projected/d63f9df6-b6f8-4181-b74b-332d89d20d5d-kube-api-access-vr5l6\") pod \"kuadrant-operator-controller-manager-86878c769f-lflmf\" (UID: \"d63f9df6-b6f8-4181-b74b-332d89d20d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:00:50.116881 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.116786    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:00:50.223761 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.223727    2559 generic.go:356] "Generic (PLEG): container finished" podID="7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998" containerID="f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46" exitCode=0
Jul 18 04:00:50.223936 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.223784    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"
Jul 18 04:00:50.223936 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.223807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s" event={"ID":"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998","Type":"ContainerDied","Data":"f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46"}
Jul 18 04:00:50.223936 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.223866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s" event={"ID":"7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998","Type":"ContainerDied","Data":"f0f76f21909f29f5e774cec24d5015a8efcff86f0bb01bacc474313dccf36e41"}
Jul 18 04:00:50.223936 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.223892    2559 scope.go:117] "RemoveContainer" containerID="f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46"
Jul 18 04:00:50.233115 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.233088    2559 scope.go:117] "RemoveContainer" containerID="f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46"
Jul 18 04:00:50.233528 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:00:50.233451    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46\": container with ID starting with f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46 not found: ID does not exist" containerID="f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46"
Jul 18 04:00:50.233528 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.233493    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46"} err="failed to get container status \"f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46\": rpc error: code = NotFound desc = could not find container \"f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46\": container with ID starting with f2a69eca97d9bcdef7496a64c775c92bc79256b0dfa4897ee013878da6342b46 not found: ID does not exist"
Jul 18 04:00:50.247722 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.247686    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"]
Jul 18 04:00:50.257035 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.257012    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"]
Jul 18 04:00:50.259222 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.259200    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w599s"]
Jul 18 04:00:50.260490 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:00:50.260465    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63f9df6_b6f8_4181_b74b_332d89d20d5d.slice/crio-24100841c0f09e51b5dc038e73ddaf82469af6deeb02246ec7ba96be52fad503 WatchSource:0}: Error finding container 24100841c0f09e51b5dc038e73ddaf82469af6deeb02246ec7ba96be52fad503: Status 404 returned error can't find the container with id 24100841c0f09e51b5dc038e73ddaf82469af6deeb02246ec7ba96be52fad503
Jul 18 04:00:50.683111 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:50.683077    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998" path="/var/lib/kubelet/pods/7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998/volumes"
Jul 18 04:00:51.230360 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:51.230323    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf" event={"ID":"d63f9df6-b6f8-4181-b74b-332d89d20d5d","Type":"ContainerStarted","Data":"69972a8402ab92741980db46ec0342de792016a40d2272dbc1a5842b6b945cf8"}
Jul 18 04:00:51.230556 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:51.230389    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:00:51.230556 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:51.230412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf" event={"ID":"d63f9df6-b6f8-4181-b74b-332d89d20d5d","Type":"ContainerStarted","Data":"24100841c0f09e51b5dc038e73ddaf82469af6deeb02246ec7ba96be52fad503"}
Jul 18 04:00:51.249480 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:00:51.249426    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf" podStartSLOduration=2.249407324 podStartE2EDuration="2.249407324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:00:51.247970543 +0000 UTC m=+649.144155734" watchObservedRunningTime="2026-07-18 04:00:51.249407324 +0000 UTC m=+649.145592515"
Jul 18 04:01:02.238331 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:02.238301    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lflmf"
Jul 18 04:01:08.446079 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.446042    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"]
Jul 18 04:01:08.446538 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.446382    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998" containerName="manager"
Jul 18 04:01:08.446538 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.446395    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998" containerName="manager"
Jul 18 04:01:08.446538 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.446450    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef9a2d1-bbb1-4a63-a312-7ca2d9f3d998" containerName="manager"
Jul 18 04:01:08.449041 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.449024    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:08.451263 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.451238    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rh7pr\""
Jul 18 04:01:08.451399 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.451311    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 18 04:01:08.455862 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.455838    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"]
Jul 18 04:01:08.539579 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.539546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5624a2b8-3cc2-4908-870b-2b2e63e07161-config-file\") pod \"limitador-limitador-64c94fd64f-q4rf8\" (UID: \"5624a2b8-3cc2-4908-870b-2b2e63e07161\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:08.539831 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.539608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzj8t\" (UniqueName: \"kubernetes.io/projected/5624a2b8-3cc2-4908-870b-2b2e63e07161-kube-api-access-vzj8t\") pod \"limitador-limitador-64c94fd64f-q4rf8\" (UID: \"5624a2b8-3cc2-4908-870b-2b2e63e07161\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:08.543562 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.543530    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"]
Jul 18 04:01:08.640572 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.640538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5624a2b8-3cc2-4908-870b-2b2e63e07161-config-file\") pod \"limitador-limitador-64c94fd64f-q4rf8\" (UID: \"5624a2b8-3cc2-4908-870b-2b2e63e07161\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:08.640776 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.640588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzj8t\" (UniqueName: \"kubernetes.io/projected/5624a2b8-3cc2-4908-870b-2b2e63e07161-kube-api-access-vzj8t\") pod \"limitador-limitador-64c94fd64f-q4rf8\" (UID: \"5624a2b8-3cc2-4908-870b-2b2e63e07161\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:08.641248 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.641228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5624a2b8-3cc2-4908-870b-2b2e63e07161-config-file\") pod \"limitador-limitador-64c94fd64f-q4rf8\" (UID: \"5624a2b8-3cc2-4908-870b-2b2e63e07161\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:08.648434 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.648404    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzj8t\" (UniqueName: \"kubernetes.io/projected/5624a2b8-3cc2-4908-870b-2b2e63e07161-kube-api-access-vzj8t\") pod \"limitador-limitador-64c94fd64f-q4rf8\" (UID: \"5624a2b8-3cc2-4908-870b-2b2e63e07161\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:08.760775 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.760746    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:08.897773 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:08.897736    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"]
Jul 18 04:01:08.902553 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:01:08.902525    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5624a2b8_3cc2_4908_870b_2b2e63e07161.slice/crio-c27521be4aa2bd0604aa74b0d78fa15e984ad3194b3bf4987a679885262c923e WatchSource:0}: Error finding container c27521be4aa2bd0604aa74b0d78fa15e984ad3194b3bf4987a679885262c923e: Status 404 returned error can't find the container with id c27521be4aa2bd0604aa74b0d78fa15e984ad3194b3bf4987a679885262c923e
Jul 18 04:01:09.313335 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:09.313304    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8" event={"ID":"5624a2b8-3cc2-4908-870b-2b2e63e07161","Type":"ContainerStarted","Data":"c27521be4aa2bd0604aa74b0d78fa15e984ad3194b3bf4987a679885262c923e"}
Jul 18 04:01:12.328770 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:12.328727    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8" event={"ID":"5624a2b8-3cc2-4908-870b-2b2e63e07161","Type":"ContainerStarted","Data":"65a16158fc4e8e562c4865665ce7bf417786fe2ec41ba795ece308d3b4966211"}
Jul 18 04:01:12.329138 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:12.328807    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:12.344836 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:12.344780    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8" podStartSLOduration=1.771092598 podStartE2EDuration="4.344762413s" totalImagesPullingTime="2.573669815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:12.342931368 +0000 UTC m=+670.239116560" watchObservedRunningTime="2026-07-18 04:01:12.344762413 +0000 UTC m=+670.240947604"
Jul 18 04:01:23.334578 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:23.334545    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:26.825973 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:26.825934    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"]
Jul 18 04:01:26.826372 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:26.826131    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8" podUID="5624a2b8-3cc2-4908-870b-2b2e63e07161" containerName="limitador" containerID="cri-o://65a16158fc4e8e562c4865665ce7bf417786fe2ec41ba795ece308d3b4966211" gracePeriod=30
Jul 18 04:01:27.396139 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:27.396049    2559 generic.go:356] "Generic (PLEG): container finished" podID="5624a2b8-3cc2-4908-870b-2b2e63e07161" containerID="65a16158fc4e8e562c4865665ce7bf417786fe2ec41ba795ece308d3b4966211" exitCode=0
Jul 18 04:01:27.396139 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:27.396124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8" event={"ID":"5624a2b8-3cc2-4908-870b-2b2e63e07161","Type":"ContainerDied","Data":"65a16158fc4e8e562c4865665ce7bf417786fe2ec41ba795ece308d3b4966211"}
Jul 18 04:01:27.771289 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:27.771265    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:27.912170 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:27.912137    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzj8t\" (UniqueName: \"kubernetes.io/projected/5624a2b8-3cc2-4908-870b-2b2e63e07161-kube-api-access-vzj8t\") pod \"5624a2b8-3cc2-4908-870b-2b2e63e07161\" (UID: \"5624a2b8-3cc2-4908-870b-2b2e63e07161\") "
Jul 18 04:01:27.912545 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:27.912216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5624a2b8-3cc2-4908-870b-2b2e63e07161-config-file\") pod \"5624a2b8-3cc2-4908-870b-2b2e63e07161\" (UID: \"5624a2b8-3cc2-4908-870b-2b2e63e07161\") "
Jul 18 04:01:27.912614 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:27.912592    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5624a2b8-3cc2-4908-870b-2b2e63e07161-config-file" (OuterVolumeSpecName: "config-file") pod "5624a2b8-3cc2-4908-870b-2b2e63e07161" (UID: "5624a2b8-3cc2-4908-870b-2b2e63e07161"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 04:01:27.914247 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:27.914216    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5624a2b8-3cc2-4908-870b-2b2e63e07161-kube-api-access-vzj8t" (OuterVolumeSpecName: "kube-api-access-vzj8t") pod "5624a2b8-3cc2-4908-870b-2b2e63e07161" (UID: "5624a2b8-3cc2-4908-870b-2b2e63e07161"). InnerVolumeSpecName "kube-api-access-vzj8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 04:01:28.013507 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:28.013468    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5624a2b8-3cc2-4908-870b-2b2e63e07161-config-file\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:01:28.013507 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:28.013499    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzj8t\" (UniqueName: \"kubernetes.io/projected/5624a2b8-3cc2-4908-870b-2b2e63e07161-kube-api-access-vzj8t\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:01:28.401961 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:28.401883    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"
Jul 18 04:01:28.401961 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:28.401905    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q4rf8" event={"ID":"5624a2b8-3cc2-4908-870b-2b2e63e07161","Type":"ContainerDied","Data":"c27521be4aa2bd0604aa74b0d78fa15e984ad3194b3bf4987a679885262c923e"}
Jul 18 04:01:28.402151 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:28.401966    2559 scope.go:117] "RemoveContainer" containerID="65a16158fc4e8e562c4865665ce7bf417786fe2ec41ba795ece308d3b4966211"
Jul 18 04:01:28.421365 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:28.421337    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"]
Jul 18 04:01:28.424638 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:28.424616    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q4rf8"]
Jul 18 04:01:28.682805 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:28.682724    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5624a2b8-3cc2-4908-870b-2b2e63e07161" path="/var/lib/kubelet/pods/5624a2b8-3cc2-4908-870b-2b2e63e07161/volumes"
Jul 18 04:01:30.106878 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.106848    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"]
Jul 18 04:01:30.107241 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.107221    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5624a2b8-3cc2-4908-870b-2b2e63e07161" containerName="limitador"
Jul 18 04:01:30.107241 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.107234    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5624a2b8-3cc2-4908-870b-2b2e63e07161" containerName="limitador"
Jul 18 04:01:30.107310 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.107293    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5624a2b8-3cc2-4908-870b-2b2e63e07161" containerName="limitador"
Jul 18 04:01:30.110073 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.110046    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:30.112703 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.112676    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 04:01:30.112703 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.112694    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 18 04:01:30.112889 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.112677    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 18 04:01:30.112889 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.112804    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zddpq\""
Jul 18 04:01:30.118142 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.118111    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"]
Jul 18 04:01:30.236467 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.236432    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a6ca269-db79-43b8-88d0-31de9e737cc7-data\") pod \"postgres-69fb4594cf-zfmqk\" (UID: \"0a6ca269-db79-43b8-88d0-31de9e737cc7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:30.236467 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.236470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvmw8\" (UniqueName: \"kubernetes.io/projected/0a6ca269-db79-43b8-88d0-31de9e737cc7-kube-api-access-lvmw8\") pod \"postgres-69fb4594cf-zfmqk\" (UID: \"0a6ca269-db79-43b8-88d0-31de9e737cc7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:30.337368 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.337329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a6ca269-db79-43b8-88d0-31de9e737cc7-data\") pod \"postgres-69fb4594cf-zfmqk\" (UID: \"0a6ca269-db79-43b8-88d0-31de9e737cc7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:30.337368 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.337369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvmw8\" (UniqueName: \"kubernetes.io/projected/0a6ca269-db79-43b8-88d0-31de9e737cc7-kube-api-access-lvmw8\") pod \"postgres-69fb4594cf-zfmqk\" (UID: \"0a6ca269-db79-43b8-88d0-31de9e737cc7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:30.337834 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.337816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a6ca269-db79-43b8-88d0-31de9e737cc7-data\") pod \"postgres-69fb4594cf-zfmqk\" (UID: \"0a6ca269-db79-43b8-88d0-31de9e737cc7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:30.344679 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.344628    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvmw8\" (UniqueName: \"kubernetes.io/projected/0a6ca269-db79-43b8-88d0-31de9e737cc7-kube-api-access-lvmw8\") pod \"postgres-69fb4594cf-zfmqk\" (UID: \"0a6ca269-db79-43b8-88d0-31de9e737cc7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:30.424753 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.424633    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:30.550760 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.550733    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"]
Jul 18 04:01:30.553388 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:01:30.553359    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6ca269_db79_43b8_88d0_31de9e737cc7.slice/crio-a05759b7b2d3be7d9ca3c4e4d0bb91491561da3ea3b119fc9aa715d2e1c5d44e WatchSource:0}: Error finding container a05759b7b2d3be7d9ca3c4e4d0bb91491561da3ea3b119fc9aa715d2e1c5d44e: Status 404 returned error can't find the container with id a05759b7b2d3be7d9ca3c4e4d0bb91491561da3ea3b119fc9aa715d2e1c5d44e
Jul 18 04:01:30.554710 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:30.554695    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 04:01:31.422260 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:31.422218    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk" event={"ID":"0a6ca269-db79-43b8-88d0-31de9e737cc7","Type":"ContainerStarted","Data":"a05759b7b2d3be7d9ca3c4e4d0bb91491561da3ea3b119fc9aa715d2e1c5d44e"}
Jul 18 04:01:35.444999 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:35.444961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk" event={"ID":"0a6ca269-db79-43b8-88d0-31de9e737cc7","Type":"ContainerStarted","Data":"db37c045ea126ed92fbaefb84f814be3f4f46ab8c3522ee98ecb6b804ff92eb7"}
Jul 18 04:01:35.445416 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:35.445069    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:35.459194 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:35.459138    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk" podStartSLOduration=0.730871437 podStartE2EDuration="5.459121141s" totalImagesPullingTime="4.728249704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:35.457307184 +0000 UTC m=+693.353492376" watchObservedRunningTime="2026-07-18 04:01:35.459121141 +0000 UTC m=+693.355306331"
Jul 18 04:01:41.479682 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:41.479635    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zfmqk"
Jul 18 04:01:48.482330 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.482291    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5dcbc6df9d-2r6r5"]
Jul 18 04:01:48.505287 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.505249    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dcbc6df9d-2r6r5"]
Jul 18 04:01:48.505467 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.505373    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:48.507397 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.507376    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 18 04:01:48.507544 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.507508    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hf46n\""
Jul 18 04:01:48.507714 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.507688    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 18 04:01:48.596298 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.596263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792165d0-e83e-4528-bd20-7addac1ee27f-webhook-cert\") pod \"maas-controller-5dcbc6df9d-2r6r5\" (UID: \"792165d0-e83e-4528-bd20-7addac1ee27f\") " pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:48.596481 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.596316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7r2k\" (UniqueName: \"kubernetes.io/projected/792165d0-e83e-4528-bd20-7addac1ee27f-kube-api-access-g7r2k\") pod \"maas-controller-5dcbc6df9d-2r6r5\" (UID: \"792165d0-e83e-4528-bd20-7addac1ee27f\") " pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:48.651342 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.651309    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bbb5c5998-4ndbm"]
Jul 18 04:01:48.653673 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.653636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:01:48.665315 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.665278    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbb5c5998-4ndbm"]
Jul 18 04:01:48.697133 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.697099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99fd9c05-d9fe-4805-ba9c-b196dd049d56-webhook-cert\") pod \"maas-controller-7bbb5c5998-4ndbm\" (UID: \"99fd9c05-d9fe-4805-ba9c-b196dd049d56\") " pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:01:48.697301 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.697153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792165d0-e83e-4528-bd20-7addac1ee27f-webhook-cert\") pod \"maas-controller-5dcbc6df9d-2r6r5\" (UID: \"792165d0-e83e-4528-bd20-7addac1ee27f\") " pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:48.697301 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.697200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbr75\" (UniqueName: \"kubernetes.io/projected/99fd9c05-d9fe-4805-ba9c-b196dd049d56-kube-api-access-wbr75\") pod \"maas-controller-7bbb5c5998-4ndbm\" (UID: \"99fd9c05-d9fe-4805-ba9c-b196dd049d56\") " pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:01:48.697301 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.697241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7r2k\" (UniqueName: \"kubernetes.io/projected/792165d0-e83e-4528-bd20-7addac1ee27f-kube-api-access-g7r2k\") pod \"maas-controller-5dcbc6df9d-2r6r5\" (UID: \"792165d0-e83e-4528-bd20-7addac1ee27f\") " pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:48.697301 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:01:48.697268    2559 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 18 04:01:48.697460 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:01:48.697327    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/792165d0-e83e-4528-bd20-7addac1ee27f-webhook-cert podName:792165d0-e83e-4528-bd20-7addac1ee27f nodeName:}" failed. No retries permitted until 2026-07-18 04:01:49.197305812 +0000 UTC m=+707.093490988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/792165d0-e83e-4528-bd20-7addac1ee27f-webhook-cert") pod "maas-controller-5dcbc6df9d-2r6r5" (UID: "792165d0-e83e-4528-bd20-7addac1ee27f") : secret "maas-controller-webhook-cert" not found
Jul 18 04:01:48.705732 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.705694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7r2k\" (UniqueName: \"kubernetes.io/projected/792165d0-e83e-4528-bd20-7addac1ee27f-kube-api-access-g7r2k\") pod \"maas-controller-5dcbc6df9d-2r6r5\" (UID: \"792165d0-e83e-4528-bd20-7addac1ee27f\") " pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:48.797891 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.797796    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99fd9c05-d9fe-4805-ba9c-b196dd049d56-webhook-cert\") pod \"maas-controller-7bbb5c5998-4ndbm\" (UID: \"99fd9c05-d9fe-4805-ba9c-b196dd049d56\") " pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:01:48.797891 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.797874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbr75\" (UniqueName: \"kubernetes.io/projected/99fd9c05-d9fe-4805-ba9c-b196dd049d56-kube-api-access-wbr75\") pod \"maas-controller-7bbb5c5998-4ndbm\" (UID: \"99fd9c05-d9fe-4805-ba9c-b196dd049d56\") " pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:01:48.800228 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.800205    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99fd9c05-d9fe-4805-ba9c-b196dd049d56-webhook-cert\") pod \"maas-controller-7bbb5c5998-4ndbm\" (UID: \"99fd9c05-d9fe-4805-ba9c-b196dd049d56\") " pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:01:48.805445 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.805417    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbr75\" (UniqueName: \"kubernetes.io/projected/99fd9c05-d9fe-4805-ba9c-b196dd049d56-kube-api-access-wbr75\") pod \"maas-controller-7bbb5c5998-4ndbm\" (UID: \"99fd9c05-d9fe-4805-ba9c-b196dd049d56\") " pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:01:48.963253 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:48.963211    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:01:49.095592 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:49.095516    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bbb5c5998-4ndbm"]
Jul 18 04:01:49.097866 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:01:49.097834    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99fd9c05_d9fe_4805_ba9c_b196dd049d56.slice/crio-3df65e0d6991ff3175f31699606d3daf978b33c9f5eea1e8c9b6d0c832a59f02 WatchSource:0}: Error finding container 3df65e0d6991ff3175f31699606d3daf978b33c9f5eea1e8c9b6d0c832a59f02: Status 404 returned error can't find the container with id 3df65e0d6991ff3175f31699606d3daf978b33c9f5eea1e8c9b6d0c832a59f02
Jul 18 04:01:49.201302 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:49.201273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792165d0-e83e-4528-bd20-7addac1ee27f-webhook-cert\") pod \"maas-controller-5dcbc6df9d-2r6r5\" (UID: \"792165d0-e83e-4528-bd20-7addac1ee27f\") " pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:49.203617 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:49.203596    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792165d0-e83e-4528-bd20-7addac1ee27f-webhook-cert\") pod \"maas-controller-5dcbc6df9d-2r6r5\" (UID: \"792165d0-e83e-4528-bd20-7addac1ee27f\") " pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:49.415509 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:49.415418    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:49.508593 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:49.508556    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbb5c5998-4ndbm" event={"ID":"99fd9c05-d9fe-4805-ba9c-b196dd049d56","Type":"ContainerStarted","Data":"3df65e0d6991ff3175f31699606d3daf978b33c9f5eea1e8c9b6d0c832a59f02"}
Jul 18 04:01:49.549032 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:49.548998    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dcbc6df9d-2r6r5"]
Jul 18 04:01:49.551910 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:01:49.551884    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792165d0_e83e_4528_bd20_7addac1ee27f.slice/crio-ac32525b94d521cdc85ef52b0588677b9e5a61a3bd8891b1c604098afe6f1f7c WatchSource:0}: Error finding container ac32525b94d521cdc85ef52b0588677b9e5a61a3bd8891b1c604098afe6f1f7c: Status 404 returned error can't find the container with id ac32525b94d521cdc85ef52b0588677b9e5a61a3bd8891b1c604098afe6f1f7c
Jul 18 04:01:50.520320 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:50.520083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5" event={"ID":"792165d0-e83e-4528-bd20-7addac1ee27f","Type":"ContainerStarted","Data":"ac32525b94d521cdc85ef52b0588677b9e5a61a3bd8891b1c604098afe6f1f7c"}
Jul 18 04:01:52.530682 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:52.530619    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bbb5c5998-4ndbm" event={"ID":"99fd9c05-d9fe-4805-ba9c-b196dd049d56","Type":"ContainerStarted","Data":"593c1ffea1e3618cec844c345e72fc1156883fde686dd352ae1c321483c6d503"}
Jul 18 04:01:52.531146 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:52.530742    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:01:52.532066 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:52.532031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5" event={"ID":"792165d0-e83e-4528-bd20-7addac1ee27f","Type":"ContainerStarted","Data":"1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01"}
Jul 18 04:01:52.532186 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:52.532121    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:01:52.547353 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:52.547297    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bbb5c5998-4ndbm" podStartSLOduration=2.095293589 podStartE2EDuration="4.547277865s" totalImagesPullingTime="2.451984276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:52.545523726 +0000 UTC m=+710.441708928" watchObservedRunningTime="2026-07-18 04:01:52.547277865 +0000 UTC m=+710.443463070"
Jul 18 04:01:52.560152 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:01:52.560090    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5" podStartSLOduration=2.558728051 podStartE2EDuration="4.560072526s" totalImagesPullingTime="2.001344475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:52.55948404 +0000 UTC m=+710.455669230" watchObservedRunningTime="2026-07-18 04:01:52.560072526 +0000 UTC m=+710.456257718"
Jul 18 04:02:03.540406 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:03.540374    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:02:03.540835 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:03.540451    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bbb5c5998-4ndbm"
Jul 18 04:02:03.596130 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:03.596095    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dcbc6df9d-2r6r5"]
Jul 18 04:02:03.596421 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:03.596366    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5" podUID="792165d0-e83e-4528-bd20-7addac1ee27f" containerName="manager" containerID="cri-o://1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01" gracePeriod=30
Jul 18 04:02:03.849036 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:03.849011    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:02:03.934948 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:03.934913    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7r2k\" (UniqueName: \"kubernetes.io/projected/792165d0-e83e-4528-bd20-7addac1ee27f-kube-api-access-g7r2k\") pod \"792165d0-e83e-4528-bd20-7addac1ee27f\" (UID: \"792165d0-e83e-4528-bd20-7addac1ee27f\") "
Jul 18 04:02:03.935106 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:03.934971    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792165d0-e83e-4528-bd20-7addac1ee27f-webhook-cert\") pod \"792165d0-e83e-4528-bd20-7addac1ee27f\" (UID: \"792165d0-e83e-4528-bd20-7addac1ee27f\") "
Jul 18 04:02:03.937054 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:03.937021    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/792165d0-e83e-4528-bd20-7addac1ee27f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "792165d0-e83e-4528-bd20-7addac1ee27f" (UID: "792165d0-e83e-4528-bd20-7addac1ee27f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 04:02:03.937054 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:03.937028    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/792165d0-e83e-4528-bd20-7addac1ee27f-kube-api-access-g7r2k" (OuterVolumeSpecName: "kube-api-access-g7r2k") pod "792165d0-e83e-4528-bd20-7addac1ee27f" (UID: "792165d0-e83e-4528-bd20-7addac1ee27f"). InnerVolumeSpecName "kube-api-access-g7r2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 04:02:04.035683 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.035607    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7r2k\" (UniqueName: \"kubernetes.io/projected/792165d0-e83e-4528-bd20-7addac1ee27f-kube-api-access-g7r2k\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:02:04.035683 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.035677    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/792165d0-e83e-4528-bd20-7addac1ee27f-webhook-cert\") on node \"ip-10-0-130-148.ec2.internal\" DevicePath \"\""
Jul 18 04:02:04.590983 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.590951    2559 generic.go:356] "Generic (PLEG): container finished" podID="792165d0-e83e-4528-bd20-7addac1ee27f" containerID="1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01" exitCode=0
Jul 18 04:02:04.591443 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.590993    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5"
Jul 18 04:02:04.591443 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.590996    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5" event={"ID":"792165d0-e83e-4528-bd20-7addac1ee27f","Type":"ContainerDied","Data":"1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01"}
Jul 18 04:02:04.591443 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.591125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dcbc6df9d-2r6r5" event={"ID":"792165d0-e83e-4528-bd20-7addac1ee27f","Type":"ContainerDied","Data":"ac32525b94d521cdc85ef52b0588677b9e5a61a3bd8891b1c604098afe6f1f7c"}
Jul 18 04:02:04.591443 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.591150    2559 scope.go:117] "RemoveContainer" containerID="1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01"
Jul 18 04:02:04.600389 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.600205    2559 scope.go:117] "RemoveContainer" containerID="1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01"
Jul 18 04:02:04.600499 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:02:04.600479    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01\": container with ID starting with 1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01 not found: ID does not exist" containerID="1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01"
Jul 18 04:02:04.600542 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.600508    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01"} err="failed to get container status \"1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01\": rpc error: code = NotFound desc = could not find container \"1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01\": container with ID starting with 1381852cebab9a142e653e41b859c9fce3584a65fc545614e0c39b4738d86d01 not found: ID does not exist"
Jul 18 04:02:04.611440 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.611410    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dcbc6df9d-2r6r5"]
Jul 18 04:02:04.617050 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.617023    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5dcbc6df9d-2r6r5"]
Jul 18 04:02:04.682263 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:04.682234    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="792165d0-e83e-4528-bd20-7addac1ee27f" path="/var/lib/kubelet/pods/792165d0-e83e-4528-bd20-7addac1ee27f/volumes"
Jul 18 04:02:24.943493 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:24.943452    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"]
Jul 18 04:02:24.943985 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:24.943900    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="792165d0-e83e-4528-bd20-7addac1ee27f" containerName="manager"
Jul 18 04:02:24.943985 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:24.943918    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="792165d0-e83e-4528-bd20-7addac1ee27f" containerName="manager"
Jul 18 04:02:24.944105 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:24.944012    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="792165d0-e83e-4528-bd20-7addac1ee27f" containerName="manager"
Jul 18 04:02:24.950559 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:24.950534    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:24.952519 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:24.952494    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 18 04:02:24.958462 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:24.958033    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"]
Jul 18 04:02:25.024590 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.024552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc42g\" (UniqueName: \"kubernetes.io/projected/a613ce70-d56a-46cb-8623-0b383d8caa38-kube-api-access-mc42g\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.024800 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.024607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a613ce70-d56a-46cb-8623-0b383d8caa38-openshift-service-ca\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.024800 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.024635    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a613ce70-d56a-46cb-8623-0b383d8caa38-maas-api-tls\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.125104 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.125064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a613ce70-d56a-46cb-8623-0b383d8caa38-openshift-service-ca\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.125104 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.125111    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a613ce70-d56a-46cb-8623-0b383d8caa38-maas-api-tls\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.125326 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.125174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc42g\" (UniqueName: \"kubernetes.io/projected/a613ce70-d56a-46cb-8623-0b383d8caa38-kube-api-access-mc42g\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.125326 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:02:25.125289    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 18 04:02:25.125431 ip-10-0-130-148 kubenswrapper[2559]: E0718 04:02:25.125354    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a613ce70-d56a-46cb-8623-0b383d8caa38-maas-api-tls podName:a613ce70-d56a-46cb-8623-0b383d8caa38 nodeName:}" failed. No retries permitted until 2026-07-18 04:02:25.625337737 +0000 UTC m=+743.521522910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a613ce70-d56a-46cb-8623-0b383d8caa38-maas-api-tls") pod "maas-api-77f94f6889-hw8bm" (UID: "a613ce70-d56a-46cb-8623-0b383d8caa38") : secret "maas-api-serving-cert" not found
Jul 18 04:02:25.125771 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.125752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a613ce70-d56a-46cb-8623-0b383d8caa38-openshift-service-ca\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.133226 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.133204    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc42g\" (UniqueName: \"kubernetes.io/projected/a613ce70-d56a-46cb-8623-0b383d8caa38-kube-api-access-mc42g\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.493521 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.493482    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"]
Jul 18 04:02:25.499873 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.499849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:25.502016 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.501993    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 18 04:02:25.507469 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.507444    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"]
Jul 18 04:02:25.526110 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.526075    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-tpwn8"]
Jul 18 04:02:25.528713 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.528686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef277012-e918-4479-9e96-b9cc17cc5744-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-g6ksd\" (UID: \"ef277012-e918-4479-9e96-b9cc17cc5744\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:25.528838 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.528781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg7qr\" (UniqueName: \"kubernetes.io/projected/ef277012-e918-4479-9e96-b9cc17cc5744-kube-api-access-dg7qr\") pod \"payload-pre-processing-7677b774bb-g6ksd\" (UID: \"ef277012-e918-4479-9e96-b9cc17cc5744\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:25.530193 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.530177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:25.532270 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.532251    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lqkbd\""
Jul 18 04:02:25.540458 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.540431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-tpwn8"]
Jul 18 04:02:25.629894 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.629861    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a613ce70-d56a-46cb-8623-0b383d8caa38-maas-api-tls\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.630071 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.629911    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ad7bd39-de5e-4d9d-8905-5e81bcf92376-plugins-config-volume\") pod \"payload-processing-5bf47cd988-tpwn8\" (UID: \"1ad7bd39-de5e-4d9d-8905-5e81bcf92376\") " pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:25.630071 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.629993    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8qd8\" (UniqueName: \"kubernetes.io/projected/1ad7bd39-de5e-4d9d-8905-5e81bcf92376-kube-api-access-s8qd8\") pod \"payload-processing-5bf47cd988-tpwn8\" (UID: \"1ad7bd39-de5e-4d9d-8905-5e81bcf92376\") " pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:25.630071 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.630043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg7qr\" (UniqueName: \"kubernetes.io/projected/ef277012-e918-4479-9e96-b9cc17cc5744-kube-api-access-dg7qr\") pod \"payload-pre-processing-7677b774bb-g6ksd\" (UID: \"ef277012-e918-4479-9e96-b9cc17cc5744\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:25.630228 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.630145    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef277012-e918-4479-9e96-b9cc17cc5744-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-g6ksd\" (UID: \"ef277012-e918-4479-9e96-b9cc17cc5744\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:25.631053 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.631024    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef277012-e918-4479-9e96-b9cc17cc5744-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-g6ksd\" (UID: \"ef277012-e918-4479-9e96-b9cc17cc5744\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:25.632494 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.632466    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a613ce70-d56a-46cb-8623-0b383d8caa38-maas-api-tls\") pod \"maas-api-77f94f6889-hw8bm\" (UID: \"a613ce70-d56a-46cb-8623-0b383d8caa38\") " pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.640183 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.640155    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg7qr\" (UniqueName: \"kubernetes.io/projected/ef277012-e918-4479-9e96-b9cc17cc5744-kube-api-access-dg7qr\") pod \"payload-pre-processing-7677b774bb-g6ksd\" (UID: \"ef277012-e918-4479-9e96-b9cc17cc5744\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:25.731442 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.731393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ad7bd39-de5e-4d9d-8905-5e81bcf92376-plugins-config-volume\") pod \"payload-processing-5bf47cd988-tpwn8\" (UID: \"1ad7bd39-de5e-4d9d-8905-5e81bcf92376\") " pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:25.731442 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.731444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8qd8\" (UniqueName: \"kubernetes.io/projected/1ad7bd39-de5e-4d9d-8905-5e81bcf92376-kube-api-access-s8qd8\") pod \"payload-processing-5bf47cd988-tpwn8\" (UID: \"1ad7bd39-de5e-4d9d-8905-5e81bcf92376\") " pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:25.732178 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.732156    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ad7bd39-de5e-4d9d-8905-5e81bcf92376-plugins-config-volume\") pod \"payload-processing-5bf47cd988-tpwn8\" (UID: \"1ad7bd39-de5e-4d9d-8905-5e81bcf92376\") " pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:25.739496 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.739464    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8qd8\" (UniqueName: \"kubernetes.io/projected/1ad7bd39-de5e-4d9d-8905-5e81bcf92376-kube-api-access-s8qd8\") pod \"payload-processing-5bf47cd988-tpwn8\" (UID: \"1ad7bd39-de5e-4d9d-8905-5e81bcf92376\") " pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:25.810516 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.810412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:25.841273 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.841213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:25.862318 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.862282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:25.974189 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:25.974160    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"]
Jul 18 04:02:25.977945 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:02:25.977918    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef277012_e918_4479_9e96_b9cc17cc5744.slice/crio-94b6098864a8849891e2aa3465281c1319f4023d5c39657f0570beb8d69ae53b WatchSource:0}: Error finding container 94b6098864a8849891e2aa3465281c1319f4023d5c39657f0570beb8d69ae53b: Status 404 returned error can't find the container with id 94b6098864a8849891e2aa3465281c1319f4023d5c39657f0570beb8d69ae53b
Jul 18 04:02:26.013228 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:26.013159    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-tpwn8"]
Jul 18 04:02:26.016056 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:02:26.016020    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad7bd39_de5e_4d9d_8905_5e81bcf92376.slice/crio-dc77567d31f4db5417106d99130d3507420bb155ae99d219263a5bdcc1ae1db0 WatchSource:0}: Error finding container dc77567d31f4db5417106d99130d3507420bb155ae99d219263a5bdcc1ae1db0: Status 404 returned error can't find the container with id dc77567d31f4db5417106d99130d3507420bb155ae99d219263a5bdcc1ae1db0
Jul 18 04:02:26.040097 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:26.040074    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"]
Jul 18 04:02:26.042606 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:02:26.042578    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda613ce70_d56a_46cb_8623_0b383d8caa38.slice/crio-0c724801533056ce0914cd05be0fd4b4465367e7f1d5f7bba16c9fbb5a5e09b3 WatchSource:0}: Error finding container 0c724801533056ce0914cd05be0fd4b4465367e7f1d5f7bba16c9fbb5a5e09b3: Status 404 returned error can't find the container with id 0c724801533056ce0914cd05be0fd4b4465367e7f1d5f7bba16c9fbb5a5e09b3
Jul 18 04:02:26.695929 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:26.695828    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd" event={"ID":"ef277012-e918-4479-9e96-b9cc17cc5744","Type":"ContainerStarted","Data":"94b6098864a8849891e2aa3465281c1319f4023d5c39657f0570beb8d69ae53b"}
Jul 18 04:02:26.699907 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:26.699830    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8" event={"ID":"1ad7bd39-de5e-4d9d-8905-5e81bcf92376","Type":"ContainerStarted","Data":"dc77567d31f4db5417106d99130d3507420bb155ae99d219263a5bdcc1ae1db0"}
Jul 18 04:02:26.701988 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:26.701921    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm" event={"ID":"a613ce70-d56a-46cb-8623-0b383d8caa38","Type":"ContainerStarted","Data":"0c724801533056ce0914cd05be0fd4b4465367e7f1d5f7bba16c9fbb5a5e09b3"}
Jul 18 04:02:29.717856 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:29.717822    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd" event={"ID":"ef277012-e918-4479-9e96-b9cc17cc5744","Type":"ContainerStarted","Data":"069e4ad2fc4bafc86edcc26e589d76425e75002badf8763e634fa5958386a77e"}
Jul 18 04:02:29.718327 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:29.717946    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:29.719734 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:29.719704    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8" event={"ID":"1ad7bd39-de5e-4d9d-8905-5e81bcf92376","Type":"ContainerStarted","Data":"4eb7bce9d1d3f006fca5b35a5ea4b421f0a12d8e7ca062c17145991f97ca41bc"}
Jul 18 04:02:29.719874 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:29.719804    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:29.721241 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:29.721219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm" event={"ID":"a613ce70-d56a-46cb-8623-0b383d8caa38","Type":"ContainerStarted","Data":"5060c5a643c6646960acc9e1bb370a7e15c1fb7331da3fc6ddf8c0979994d9db"}
Jul 18 04:02:29.721351 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:29.721337    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:29.731934 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:29.731887    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd" podStartSLOduration=1.8814910569999999 podStartE2EDuration="4.731871035s" totalImagesPullingTime="2.850379978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:02:29.731221367 +0000 UTC m=+747.627406580" watchObservedRunningTime="2026-07-18 04:02:29.731871035 +0000 UTC m=+747.628056227"
Jul 18 04:02:29.745826 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:29.745769    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8" podStartSLOduration=1.9396904560000001 podStartE2EDuration="4.745749525s" totalImagesPullingTime="2.806059069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:02:29.744073511 +0000 UTC m=+747.640258715" watchObservedRunningTime="2026-07-18 04:02:29.745749525 +0000 UTC m=+747.641934715"
Jul 18 04:02:29.758684 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:29.758615    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm" podStartSLOduration=3.038464635 podStartE2EDuration="5.75859671s" totalImagesPullingTime="2.720132075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:02:29.756949457 +0000 UTC m=+747.653134644" watchObservedRunningTime="2026-07-18 04:02:29.75859671 +0000 UTC m=+747.654781901"
Jul 18 04:02:35.731169 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:35.731141    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-77f94f6889-hw8bm"
Jul 18 04:02:40.727585 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:40.727546    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-g6ksd"
Jul 18 04:02:40.728036 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:40.727624    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-tpwn8"
Jul 18 04:02:47.967423 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:47.967385    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"]
Jul 18 04:02:47.972283 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:47.972257    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:47.974296 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:47.974268    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 18 04:02:47.975146 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:47.975126    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w78lm\""
Jul 18 04:02:47.975261 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:47.975142    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 04:02:47.975261 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:47.975167    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 04:02:47.978334 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:47.978316    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"]
Jul 18 04:02:48.037586 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.037552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.037819 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.037591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.037819 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.037615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.037819 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.037726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.037819 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.037773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vl2p\" (UniqueName: \"kubernetes.io/projected/f856efc1-c606-4148-adaa-232fe42d3bd4-kube-api-access-9vl2p\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.037992 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.037858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f856efc1-c606-4148-adaa-232fe42d3bd4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.138699 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.138639    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.138699 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.138703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.138988 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.138732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.138988 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.138764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.138988 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.138790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vl2p\" (UniqueName: \"kubernetes.io/projected/f856efc1-c606-4148-adaa-232fe42d3bd4-kube-api-access-9vl2p\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.138988 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.138841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f856efc1-c606-4148-adaa-232fe42d3bd4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.139213 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.139165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.139275 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.139215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.139275 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.139230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.141035 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.141006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f856efc1-c606-4148-adaa-232fe42d3bd4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.141466 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.141445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f856efc1-c606-4148-adaa-232fe42d3bd4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.146055 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.146029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vl2p\" (UniqueName: \"kubernetes.io/projected/f856efc1-c606-4148-adaa-232fe42d3bd4-kube-api-access-9vl2p\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp\" (UID: \"f856efc1-c606-4148-adaa-232fe42d3bd4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.284847 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.284761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:48.424988 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.424885    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"]
Jul 18 04:02:48.427102 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:02:48.427075    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf856efc1_c606_4148_adaa_232fe42d3bd4.slice/crio-ae8e721b77f103fcf97c74821cd8e68be63ac59b98b10621f9580c4a25ce95c6 WatchSource:0}: Error finding container ae8e721b77f103fcf97c74821cd8e68be63ac59b98b10621f9580c4a25ce95c6: Status 404 returned error can't find the container with id ae8e721b77f103fcf97c74821cd8e68be63ac59b98b10621f9580c4a25ce95c6
Jul 18 04:02:48.812259 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:48.812220    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp" event={"ID":"f856efc1-c606-4148-adaa-232fe42d3bd4","Type":"ContainerStarted","Data":"ae8e721b77f103fcf97c74821cd8e68be63ac59b98b10621f9580c4a25ce95c6"}
Jul 18 04:02:49.819116 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:49.819084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp" event={"ID":"f856efc1-c606-4148-adaa-232fe42d3bd4","Type":"ContainerStarted","Data":"a69a7fc398674b5ee2e4690a82bcd5a5bf2d66c524021629813bcc2a790ccf1a"}
Jul 18 04:02:49.854874 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:49.854819    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp" podStartSLOduration=1.644875887 podStartE2EDuration="2.854801691s" totalImagesPullingTime="1.209925804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:02:49.851270098 +0000 UTC m=+767.747455288" watchObservedRunningTime="2026-07-18 04:02:49.854801691 +0000 UTC m=+767.750986909"
Jul 18 04:02:58.285544 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:58.285497    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:58.286165 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:58.285592    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:58.298338 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:58.298309    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:02:58.875480 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:02:58.875446    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp"
Jul 18 04:03:01.860998 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:01.860959    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"]
Jul 18 04:03:01.894420 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:01.894373    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"]
Jul 18 04:03:01.894420 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:01.894415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:01.896622 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:01.896598    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 18 04:03:02.066796 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.066760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.066962 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.066816    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvgdc\" (UniqueName: \"kubernetes.io/projected/32fae6ab-2fe3-48cc-b453-a81686c04ebd-kube-api-access-fvgdc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.066962 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.066862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32fae6ab-2fe3-48cc-b453-a81686c04ebd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.066962 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.066920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.066962 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.066952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.067094 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.066973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.167703 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.167590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32fae6ab-2fe3-48cc-b453-a81686c04ebd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.167703 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.167638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.167703 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.167706    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.167957 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.167725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.167957 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.167756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.167957 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.167843    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvgdc\" (UniqueName: \"kubernetes.io/projected/32fae6ab-2fe3-48cc-b453-a81686c04ebd-kube-api-access-fvgdc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.168219 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.168187    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.168358 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.168259    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.168358 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.168300    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.170122 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.170101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32fae6ab-2fe3-48cc-b453-a81686c04ebd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.170428 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.170408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32fae6ab-2fe3-48cc-b453-a81686c04ebd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.174904 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.174880    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvgdc\" (UniqueName: \"kubernetes.io/projected/32fae6ab-2fe3-48cc-b453-a81686c04ebd-kube-api-access-fvgdc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2qrr8\" (UID: \"32fae6ab-2fe3-48cc-b453-a81686c04ebd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.204952 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.204907    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:02.344468 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.344433    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"]
Jul 18 04:03:02.347635 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:03:02.347607    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32fae6ab_2fe3_48cc_b453_a81686c04ebd.slice/crio-5d5c33d3975e30c134e95b6e76930553565234fd1107ba5972aab85051a39e68 WatchSource:0}: Error finding container 5d5c33d3975e30c134e95b6e76930553565234fd1107ba5972aab85051a39e68: Status 404 returned error can't find the container with id 5d5c33d3975e30c134e95b6e76930553565234fd1107ba5972aab85051a39e68
Jul 18 04:03:02.885107 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.885020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8" event={"ID":"32fae6ab-2fe3-48cc-b453-a81686c04ebd","Type":"ContainerStarted","Data":"2434516af5c158fcabb948e2acb5b7000c85527023d1bdda62994c6a4f0d6714"}
Jul 18 04:03:02.885107 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.885070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8" event={"ID":"32fae6ab-2fe3-48cc-b453-a81686c04ebd","Type":"ContainerStarted","Data":"5d5c33d3975e30c134e95b6e76930553565234fd1107ba5972aab85051a39e68"}
Jul 18 04:03:02.900254 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:02.900197    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8" podStartSLOduration=1.716277355 podStartE2EDuration="1.900178804s" totalImagesPullingTime="183.901449ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:03:02.899066912 +0000 UTC m=+780.795252103" watchObservedRunningTime="2026-07-18 04:03:02.900178804 +0000 UTC m=+780.796363995"
Jul 18 04:03:12.205789 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:12.205750    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:12.206250 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:12.205847    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:12.221816 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:12.221786    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:12.942314 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:12.942284    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2qrr8"
Jul 18 04:03:43.961019 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:43.960982    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"]
Jul 18 04:03:43.966640 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:43.966614    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:43.968807 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:43.968786    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 18 04:03:43.973525 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:43.973501    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"]
Jul 18 04:03:44.052391 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.052352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.052391 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.052406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.052635 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.052478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-257qh\" (UniqueName: \"kubernetes.io/projected/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-kube-api-access-257qh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.052635 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.052542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.052635 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.052574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.052635 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.052617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.153522 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.153485    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.153700 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.153534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.153700 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.153583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-257qh\" (UniqueName: \"kubernetes.io/projected/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-kube-api-access-257qh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.153700 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.153636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.153700 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.153689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.153857 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.153730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.153972 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.153949    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.154104 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.154078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.154149 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.154129    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.155950 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.155925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.156148 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.156130    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.160676 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.160624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-257qh\" (UniqueName: \"kubernetes.io/projected/5ac880e2-4cb2-49d7-aa16-cf1518b511c1-kube-api-access-257qh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt\" (UID: \"5ac880e2-4cb2-49d7-aa16-cf1518b511c1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.279146 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.279113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:44.419933 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:44.419898    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"]
Jul 18 04:03:44.422320 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:03:44.422288    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ac880e2_4cb2_49d7_aa16_cf1518b511c1.slice/crio-dfd5d17a164185d280b4c2b67bcba5610e644ebbbda1abff70827473d4e53aa9 WatchSource:0}: Error finding container dfd5d17a164185d280b4c2b67bcba5610e644ebbbda1abff70827473d4e53aa9: Status 404 returned error can't find the container with id dfd5d17a164185d280b4c2b67bcba5610e644ebbbda1abff70827473d4e53aa9
Jul 18 04:03:45.091120 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:45.091073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt" event={"ID":"5ac880e2-4cb2-49d7-aa16-cf1518b511c1","Type":"ContainerStarted","Data":"5dc43f40dde0d629f78cd9f78ae6b264d3039eb5e524e100fd7aa2c66d0ec276"}
Jul 18 04:03:45.091120 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:45.091119    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt" event={"ID":"5ac880e2-4cb2-49d7-aa16-cf1518b511c1","Type":"ContainerStarted","Data":"dfd5d17a164185d280b4c2b67bcba5610e644ebbbda1abff70827473d4e53aa9"}
Jul 18 04:03:45.106587 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:45.106529    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt" podStartSLOduration=1.924150059 podStartE2EDuration="2.106511722s" totalImagesPullingTime="182.361663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:03:45.10532203 +0000 UTC m=+823.001507220" watchObservedRunningTime="2026-07-18 04:03:45.106511722 +0000 UTC m=+823.002696912"
Jul 18 04:03:54.280135 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:54.280092    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:54.280508 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:54.280181    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:54.292987 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:54.292959    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:03:55.156629 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:03:55.156592    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt"
Jul 18 04:05:22.203800 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:22.203769    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-p4nv6_beb33580-a505-4b26-9aba-d819a78e0e54/manager/0.log"
Jul 18 04:05:22.323280 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:22.323242    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9hswv_d2b46568-8ffa-41ff-8e79-5195c6291041/manager/0.log"
Jul 18 04:05:22.439988 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:22.439955    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bbb5c5998-4ndbm_99fd9c05-d9fe-4805-ba9c-b196dd049d56/manager/0.log"
Jul 18 04:05:22.798369 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:22.798336    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-jv5gx_1c973f32-827a-4362-868f-d2933eaf6939/manager/0.log"
Jul 18 04:05:22.803992 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:22.803965    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-jv5gx_1c973f32-827a-4362-868f-d2933eaf6939/copy-manifests/0.log"
Jul 18 04:05:23.378770 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:23.378741    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-77f94f6889-hw8bm_a613ce70-d56a-46cb-8623-0b383d8caa38/maas-api/0.log"
Jul 18 04:05:23.484946 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:23.484918    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zfmqk_0a6ca269-db79-43b8-88d0-31de9e737cc7/postgres/0.log"
Jul 18 04:05:24.877064 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:24.877027    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-shvk5_41c37bd6-1e50-4c4a-84dd-7e487bc180ee/manager/0.log"
Jul 18 04:05:24.989121 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:24.989085    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tsn6d_5834ac67-128f-4fd6-86b3-f49a5e434e66/manager/0.log"
Jul 18 04:05:25.206842 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:25.206763    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5ldlg_d8011469-b034-4c90-825e-0aaccfdbe704/registry-server/0.log"
Jul 18 04:05:25.338705 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:25.338666    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lflmf_d63f9df6-b6f8-4181-b74b-332d89d20d5d/manager/0.log"
Jul 18 04:05:25.609891 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:25.609858    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n7wvl_5fb31e58-68d2-4fab-bb5f-bf5f05a0285b/manager/0.log"
Jul 18 04:05:26.286807 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:26.286775    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c5cf7cfd-k8dxm_b08023ec-5f1b-403f-a459-bff9a0e1ee71/kube-auth-proxy/0.log"
Jul 18 04:05:26.504637 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:26.504611    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-g6ksd_ef277012-e918-4479-9e96-b9cc17cc5744/payload-pre-processing/0.log"
Jul 18 04:05:26.611144 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:26.611046    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-tpwn8_1ad7bd39-de5e-4d9d-8905-5e81bcf92376/payload-processing/0.log"
Jul 18 04:05:27.044309 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:27.044279    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8qdmp_f856efc1-c606-4148-adaa-232fe42d3bd4/main/0.log"
Jul 18 04:05:27.251179 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:27.251148    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2qrr8_32fae6ab-2fe3-48cc-b453-a81686c04ebd/main/0.log"
Jul 18 04:05:27.578909 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:27.578881    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-k7qmt_5ac880e2-4cb2-49d7-aa16-cf1518b511c1/main/0.log"
Jul 18 04:05:35.279188 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:35.279154    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bl8ng_a61c4a15-f6f1-4663-a64c-85f4cd9465d9/global-pull-secret-syncer/0.log"
Jul 18 04:05:35.413736 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:35.413706    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jdpnj_0717052e-a7b0-42f8-8a5d-473afb719b7c/konnectivity-agent/0.log"
Jul 18 04:05:35.464371 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:35.464333    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-148.ec2.internal_ac85b0e2c258f1bb28fc0a607b6ac4d7/haproxy/0.log"
Jul 18 04:05:40.485717 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:40.485672    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-shvk5_41c37bd6-1e50-4c4a-84dd-7e487bc180ee/manager/0.log"
Jul 18 04:05:40.509389 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:40.509362    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tsn6d_5834ac67-128f-4fd6-86b3-f49a5e434e66/manager/0.log"
Jul 18 04:05:40.565783 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:40.565758    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5ldlg_d8011469-b034-4c90-825e-0aaccfdbe704/registry-server/0.log"
Jul 18 04:05:40.621418 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:40.621382    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lflmf_d63f9df6-b6f8-4181-b74b-332d89d20d5d/manager/0.log"
Jul 18 04:05:40.692209 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:40.692174    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n7wvl_5fb31e58-68d2-4fab-bb5f-bf5f05a0285b/manager/0.log"
Jul 18 04:05:42.752509 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:42.752482    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7s6r2_bf96301a-60e8-4e7c-bc85-76a17d3a3de0/node-exporter/0.log"
Jul 18 04:05:42.771133 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:42.771105    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7s6r2_bf96301a-60e8-4e7c-bc85-76a17d3a3de0/kube-rbac-proxy/0.log"
Jul 18 04:05:42.792158 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:42.792130    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7s6r2_bf96301a-60e8-4e7c-bc85-76a17d3a3de0/init-textfile/0.log"
Jul 18 04:05:43.024747 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.024725    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79b2d740-489f-40f7-a8d6-3e662859b46a/prometheus/0.log"
Jul 18 04:05:43.045604 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.045576    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79b2d740-489f-40f7-a8d6-3e662859b46a/config-reloader/0.log"
Jul 18 04:05:43.066368 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.066339    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79b2d740-489f-40f7-a8d6-3e662859b46a/thanos-sidecar/0.log"
Jul 18 04:05:43.088790 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.088752    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79b2d740-489f-40f7-a8d6-3e662859b46a/kube-rbac-proxy-web/0.log"
Jul 18 04:05:43.107389 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.107364    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79b2d740-489f-40f7-a8d6-3e662859b46a/kube-rbac-proxy/0.log"
Jul 18 04:05:43.128344 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.128317    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79b2d740-489f-40f7-a8d6-3e662859b46a/kube-rbac-proxy-thanos/0.log"
Jul 18 04:05:43.148376 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.148350    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79b2d740-489f-40f7-a8d6-3e662859b46a/init-config-reloader/0.log"
Jul 18 04:05:43.242474 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.242442    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65b97c755f-md4l6_1bfaef66-4b8b-4f2a-8b95-d78a29001531/telemeter-client/0.log"
Jul 18 04:05:43.260943 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.260908    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65b97c755f-md4l6_1bfaef66-4b8b-4f2a-8b95-d78a29001531/reload/0.log"
Jul 18 04:05:43.280375 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:43.280295    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65b97c755f-md4l6_1bfaef66-4b8b-4f2a-8b95-d78a29001531/kube-rbac-proxy/0.log"
Jul 18 04:05:45.857615 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.857580    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"]
Jul 18 04:05:45.861527 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.861497    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:45.863961 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.863940    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2q2dr\"/\"default-dockercfg-tcmmh\""
Jul 18 04:05:45.864080 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.864036    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2q2dr\"/\"kube-root-ca.crt\""
Jul 18 04:05:45.864080 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.864048    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2q2dr\"/\"openshift-service-ca.crt\""
Jul 18 04:05:45.870296 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.870271    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"]
Jul 18 04:05:45.886072 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.886034    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-6sb5r_2f07f73f-dffd-4e5f-b72a-6c036260ef49/download-server/0.log"
Jul 18 04:05:45.994331 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.994288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-proc\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:45.994331 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.994329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-lib-modules\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:45.994539 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.994356    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c695w\" (UniqueName: \"kubernetes.io/projected/0883ad5a-85aa-4993-a4bf-feae8487315f-kube-api-access-c695w\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:45.994539 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.994443    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-sys\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:45.994539 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:45.994478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-podres\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.095346 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.095304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-proc\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.095346 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.095344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-lib-modules\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.095528 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.095366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c695w\" (UniqueName: \"kubernetes.io/projected/0883ad5a-85aa-4993-a4bf-feae8487315f-kube-api-access-c695w\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.095528 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.095444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-proc\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.095528 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.095483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-sys\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.095528 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.095493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-lib-modules\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.095528 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.095509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-podres\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.095709 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.095549    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-sys\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.095709 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.095630    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0883ad5a-85aa-4993-a4bf-feae8487315f-podres\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.102498 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.102478    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c695w\" (UniqueName: \"kubernetes.io/projected/0883ad5a-85aa-4993-a4bf-feae8487315f-kube-api-access-c695w\") pod \"perf-node-gather-daemonset-d9xvj\" (UID: \"0883ad5a-85aa-4993-a4bf-feae8487315f\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.173418 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.173326    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.307562 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.307528    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"]
Jul 18 04:05:46.310739 ip-10-0-130-148 kubenswrapper[2559]: W0718 04:05:46.310710    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0883ad5a_85aa_4993_a4bf_feae8487315f.slice/crio-2bc0e5a941348b8cb4ef1ab5d63188038c4a6bc12927cfa1b6e26d5c853e4a98 WatchSource:0}: Error finding container 2bc0e5a941348b8cb4ef1ab5d63188038c4a6bc12927cfa1b6e26d5c853e4a98: Status 404 returned error can't find the container with id 2bc0e5a941348b8cb4ef1ab5d63188038c4a6bc12927cfa1b6e26d5c853e4a98
Jul 18 04:05:46.682113 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.682083    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:46.682276 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.682130    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj" event={"ID":"0883ad5a-85aa-4993-a4bf-feae8487315f","Type":"ContainerStarted","Data":"1364995cd69c33277af7cfa28470e29014b195ec54ad75d0a317417d91b04420"}
Jul 18 04:05:46.682276 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.682148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj" event={"ID":"0883ad5a-85aa-4993-a4bf-feae8487315f","Type":"ContainerStarted","Data":"2bc0e5a941348b8cb4ef1ab5d63188038c4a6bc12927cfa1b6e26d5c853e4a98"}
Jul 18 04:05:46.695284 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:46.695235    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj" podStartSLOduration=1.6952196000000002 podStartE2EDuration="1.6952196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 04:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:05:46.693848904 +0000 UTC m=+944.590034094" watchObservedRunningTime="2026-07-18 04:05:46.6952196 +0000 UTC m=+944.591404790"
Jul 18 04:05:47.672790 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:47.672760    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s6q77_9e657418-e3de-471d-b1a6-26019a3da8fa/dns/0.log"
Jul 18 04:05:47.692986 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:47.692959    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s6q77_9e657418-e3de-471d-b1a6-26019a3da8fa/kube-rbac-proxy/0.log"
Jul 18 04:05:47.754407 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:47.754382    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mtcnq_0758e022-73b9-4f35-96e8-5d297cb56356/dns-node-resolver/0.log"
Jul 18 04:05:48.246370 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:48.246334    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54bb5cd49-47r8l_0cc6f894-009d-43a1-9f4d-44317d041674/registry/0.log"
Jul 18 04:05:48.289890 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:48.289866    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p7ld9_958b9f76-31bd-4650-9982-96e485a636b9/node-ca/0.log"
Jul 18 04:05:49.285233 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:49.285206    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c5cf7cfd-k8dxm_b08023ec-5f1b-403f-a459-bff9a0e1ee71/kube-auth-proxy/0.log"
Jul 18 04:05:49.339995 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:49.339969    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-g6ksd_ef277012-e918-4479-9e96-b9cc17cc5744/payload-pre-processing/0.log"
Jul 18 04:05:49.363538 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:49.363505    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-tpwn8_1ad7bd39-de5e-4d9d-8905-5e81bcf92376/payload-processing/0.log"
Jul 18 04:05:50.022048 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:50.022017    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z79sn_201aa012-979d-450c-9f8c-3bdc4ada48c3/serve-healthcheck-canary/0.log"
Jul 18 04:05:50.489282 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:50.489255    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d6sgk_3e726d1a-b9b5-4d24-8d8e-944743b29335/kube-rbac-proxy/0.log"
Jul 18 04:05:50.507835 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:50.507809    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d6sgk_3e726d1a-b9b5-4d24-8d8e-944743b29335/exporter/0.log"
Jul 18 04:05:50.526790 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:50.526761    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d6sgk_3e726d1a-b9b5-4d24-8d8e-944743b29335/extractor/0.log"
Jul 18 04:05:52.689493 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:52.689463    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-p4nv6_beb33580-a505-4b26-9aba-d819a78e0e54/manager/0.log"
Jul 18 04:05:52.694612 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:52.694589    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-d9xvj"
Jul 18 04:05:52.723784 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:52.723751    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9hswv_d2b46568-8ffa-41ff-8e79-5195c6291041/manager/0.log"
Jul 18 04:05:52.749828 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:52.749798    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bbb5c5998-4ndbm_99fd9c05-d9fe-4805-ba9c-b196dd049d56/manager/0.log"
Jul 18 04:05:52.857562 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:52.857532    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-jv5gx_1c973f32-827a-4362-868f-d2933eaf6939/manager/0.log"
Jul 18 04:05:52.879994 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:52.879966    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-jv5gx_1c973f32-827a-4362-868f-d2933eaf6939/copy-manifests/0.log"
Jul 18 04:05:56.350866 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:56.350840    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c5cf7cfd-k8dxm_b08023ec-5f1b-403f-a459-bff9a0e1ee71/kube-auth-proxy/0.log"
Jul 18 04:05:56.379854 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:56.379826    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-g6ksd_ef277012-e918-4479-9e96-b9cc17cc5744/payload-pre-processing/0.log"
Jul 18 04:05:56.395339 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:56.395311    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-tpwn8_1ad7bd39-de5e-4d9d-8905-5e81bcf92376/payload-processing/0.log"
Jul 18 04:05:57.787443 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:57.787417    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85c5cf7cfd-k8dxm_b08023ec-5f1b-403f-a459-bff9a0e1ee71/kube-auth-proxy/0.log"
Jul 18 04:05:57.816684 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:57.816642    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-g6ksd_ef277012-e918-4479-9e96-b9cc17cc5744/payload-pre-processing/0.log"
Jul 18 04:05:57.831767 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:05:57.831736    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-tpwn8_1ad7bd39-de5e-4d9d-8905-5e81bcf92376/payload-processing/0.log"
Jul 18 04:06:00.974702 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:00.974674    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnp6s_8efa1cd9-f09e-4141-9316-ab2a3d47b404/kube-multus-additional-cni-plugins/0.log"
Jul 18 04:06:00.993089 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:00.993061    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnp6s_8efa1cd9-f09e-4141-9316-ab2a3d47b404/egress-router-binary-copy/0.log"
Jul 18 04:06:01.016002 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:01.015966    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnp6s_8efa1cd9-f09e-4141-9316-ab2a3d47b404/cni-plugins/0.log"
Jul 18 04:06:01.035208 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:01.035184    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnp6s_8efa1cd9-f09e-4141-9316-ab2a3d47b404/bond-cni-plugin/0.log"
Jul 18 04:06:01.053859 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:01.053830    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnp6s_8efa1cd9-f09e-4141-9316-ab2a3d47b404/routeoverride-cni/0.log"
Jul 18 04:06:01.071870 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:01.071846    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnp6s_8efa1cd9-f09e-4141-9316-ab2a3d47b404/whereabouts-cni-bincopy/0.log"
Jul 18 04:06:01.090438 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:01.090414    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnp6s_8efa1cd9-f09e-4141-9316-ab2a3d47b404/whereabouts-cni/0.log"
Jul 18 04:06:01.177763 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:01.177731    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h4dcs_f1861f9a-f8b9-491d-a70e-3fa4079d3e3a/kube-multus/0.log"
Jul 18 04:06:01.195661 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:01.195629    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-48dcs_65190cd9-1a6c-4358-9309-30c238568f7a/network-metrics-daemon/0.log"
Jul 18 04:06:01.214588 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:01.214561    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-48dcs_65190cd9-1a6c-4358-9309-30c238568f7a/kube-rbac-proxy/0.log"
Jul 18 04:06:02.390772 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:02.390665    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7d9sr_efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb/ovn-controller/0.log"
Jul 18 04:06:02.407818 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:02.407794    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7d9sr_efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb/ovn-acl-logging/0.log"
Jul 18 04:06:02.433132 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:02.433082    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7d9sr_efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb/kube-rbac-proxy-node/0.log"
Jul 18 04:06:02.450609 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:02.450583    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7d9sr_efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb/kube-rbac-proxy-ovn-metrics/0.log"
Jul 18 04:06:02.465668 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:02.465622    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7d9sr_efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb/northd/0.log"
Jul 18 04:06:02.483310 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:02.483281    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7d9sr_efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb/nbdb/0.log"
Jul 18 04:06:02.501554 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:02.501529    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7d9sr_efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb/sbdb/0.log"
Jul 18 04:06:02.544107 ip-10-0-130-148 kubenswrapper[2559]: I0718 04:06:02.544072    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7d9sr_efa3ca27-4ac9-48cc-aff4-4ec32a3f3ceb/ovnkube-controller/0.log"