Jul 10 22:55:45.398066 ip-10-0-135-146 systemd[1]: Starting Kubernetes Kubelet... Jul 10 22:55:45.724086 ip-10-0-135-146 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 22:55:45.724086 ip-10-0-135-146 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 22:55:45.724086 ip-10-0-135-146 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 22:55:45.724086 ip-10-0-135-146 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 22:55:45.724086 ip-10-0-135-146 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 22:55:45.725444 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.725351 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 22:55:45.730032 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730005 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:55:45.730032 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730027 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:55:45.730032 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730031 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:55:45.730032 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730034 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:55:45.730032 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730040 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:55:45.730032 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730043 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730046 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730049 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730052 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730055 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730058 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730060 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730063 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730066 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730068 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730071 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730074 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730076 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730079 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730081 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730084 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730086 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730089 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730092 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:55:45.730261 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730094 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730097 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730099 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730103 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730106 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730111 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730114 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730117 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730119 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730122 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730124 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730127 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730129 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730132 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730135 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730138 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730141 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730144 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730146 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730149 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:55:45.730734 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730152 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730155 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730159 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730163 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730169 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730173 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730176 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730179 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730182 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730185 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730188 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730191 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730195 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730198 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730201 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730204 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730207 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730209 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730212 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:55:45.731251 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730214 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730217 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730219 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730222 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730224 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730228 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730230 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730233 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730236 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730239 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730242 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730244 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730247 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730250 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730252 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730255 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730257 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730260 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730263 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730266 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:55:45.731723 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730270 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730274 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730276 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730279 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730282 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730285 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730288 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730290 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730293 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730296 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730298 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730301 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730304 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730306 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730309 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.730311 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731085 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731093 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731097 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731101 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:55:45.732206 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731104 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731107 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731110 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731113 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731116 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731119 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731122 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731125 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731128 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731131 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731133 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731136 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731139 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731142 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731144 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731147 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731151 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731153 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731156 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731159 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731162 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:55:45.732688 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731165 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731167 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731170 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731173 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731175 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731178 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731181 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731184 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731186 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731190 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731193 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731196 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731198 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731201 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731203 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731206 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731209 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731211 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731214 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:55:45.733234 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731218 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731221 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731224 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731227 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731230 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731233 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731236 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731239 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731242 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731245 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731248 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731250 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731253 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731256 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731259 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731262 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731266 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731268 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731271 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731273 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:55:45.733828 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731276 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731279 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731281 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731284 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731287 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731289 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731292 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731294 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731297 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731300 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731302 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731304 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731308 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731312 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731314 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731317 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731320 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731323 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731325 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:55:45.734322 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731328 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731330 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731333 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731335 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731338 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731341 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731343 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731346 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731348 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731350 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731353 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731355 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731358 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731360 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731363 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731365 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731799 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731805 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731809 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731811 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:55:45.734806 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731814 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731818 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731821 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731823 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731828 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731832 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731835 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731838 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731840 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731843 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731846 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731848 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731852 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731854 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731856 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731859 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731862 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731864 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731867 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:55:45.735287 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731870 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731872 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731875 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731877 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731880 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731882 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731885 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731888 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731891 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731894 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731897 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731899 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731902 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731904 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731907 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731910 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731913 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731917 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731920 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:55:45.735756 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731923 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731926 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731929 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731932 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731934 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731937 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731940 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731949 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731952 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731955 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731958 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731960 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731963 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731965 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731968 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731970 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731973 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731975 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731977 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731980 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:55:45.736220 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731982 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731986 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731989 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731992 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731995 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.731997 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732000 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732003 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732005 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732008 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732010 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732012 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732015 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732018 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732020 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732023 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732025 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732028 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732030 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732032 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:55:45.736699 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732041 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732044 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732047 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732051 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732053 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732056 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732060 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732064 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732066 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732069 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732071 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732074 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732076 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732079 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732082 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732085 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732087 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732166 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732174 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732182 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732188 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 22:55:45.737216 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732194 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732199 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732205 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732212 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732216 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732219 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732223 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732226 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732230 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732233 2578 flags.go:64] FLAG: --cgroup-root="" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732235 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732238 2578 flags.go:64] FLAG: --client-ca-file="" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732248 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732251 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732256 2578 flags.go:64] FLAG: --cluster-domain="" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732259 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732262 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732268 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732271 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732275 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732278 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732281 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732285 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732287 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 10 22:55:45.737745 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732290 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732293 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732296 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732299 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732303 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732306 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732309 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732312 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732314 2578 flags.go:64] FLAG: --enable-server="true" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732317 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732323 2578 flags.go:64] FLAG: --event-burst="100" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732326 2578 flags.go:64] FLAG: --event-qps="50" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732328 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732331 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732334 2578 flags.go:64] FLAG: --eviction-hard="" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732338 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732340 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732343 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732346 2578 flags.go:64] FLAG: --eviction-soft="" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732349 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732353 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732356 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732359 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732362 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732364 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 22:55:45.738319 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732370 2578 flags.go:64] FLAG: --feature-gates="" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732373 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732376 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732379 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732383 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732386 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732389 2578 flags.go:64] FLAG: --help="false" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732392 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-146.ec2.internal" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732395 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732398 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732401 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732404 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732407 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732410 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732413 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732416 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732419 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732422 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732425 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732428 2578 flags.go:64] FLAG: --kube-reserved="" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732430 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732433 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732436 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732439 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 22:55:45.739060 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732441 2578 flags.go:64] FLAG: --lock-file="" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732444 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732447 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732450 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732456 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732460 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732463 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732466 2578 flags.go:64] FLAG: --logging-format="text" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732471 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732475 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732478 2578 flags.go:64] FLAG: --manifest-url="" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732481 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732485 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732488 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732492 2578 flags.go:64] FLAG: --max-pods="110" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732495 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732498 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732501 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732504 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732507 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732510 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732513 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732521 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732524 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732527 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 22:55:45.740097 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732530 2578 flags.go:64] FLAG: --pod-cidr="" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732532 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732538 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732540 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732544 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732547 2578 flags.go:64] FLAG: --port="10250" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732550 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732553 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-092b3aa9b6bfd858a" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732556 2578 flags.go:64] FLAG: --qos-reserved="" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732558 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732561 2578 flags.go:64] FLAG: --register-node="true" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732564 2578 flags.go:64] FLAG: --register-with-taints="" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732568 2578 flags.go:64] FLAG: --registry-burst="10" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732572 2578 flags.go:64] FLAG: --registry-qps="5" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732575 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732579 2578 flags.go:64] FLAG: --reserved-memory="" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732584 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732588 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732591 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732594 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732596 2578 flags.go:64] FLAG: --runonce="false" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732599 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732602 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732605 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732608 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 22:55:45.741164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732611 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732614 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732617 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732620 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732622 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732625 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732628 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732631 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732634 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732637 2578 flags.go:64] FLAG: --system-cgroups="" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732640 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732645 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732648 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732651 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732655 2578 flags.go:64] FLAG: --tls-min-version="" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732658 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732661 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732663 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732666 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732669 2578 flags.go:64] FLAG: --v="2" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732673 2578 flags.go:64] FLAG: --version="false" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732679 2578 flags.go:64] FLAG: --vmodule="" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732683 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.732688 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732831 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:55:45.742269 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732836 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732839 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732842 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732846 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732849 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732852 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732855 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732858 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732861 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732863 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732866 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732868 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732871 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732874 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732877 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732879 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732882 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732885 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732887 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732890 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:55:45.743313 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732892 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732895 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732897 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732900 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732903 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732905 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732908 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732910 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732913 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732918 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732923 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732925 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732928 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732930 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732933 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732936 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732938 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732940 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732943 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732945 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:55:45.743972 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732948 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732950 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732953 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732955 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732958 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732962 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732966 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732969 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732972 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732975 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732977 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732980 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732983 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732985 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732988 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732990 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732993 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732996 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.732998 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:55:45.744818 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733001 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733003 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733007 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733011 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733014 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733017 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733019 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733022 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733024 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733028 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733031 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733034 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733037 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733040 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733043 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733046 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733048 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733051 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733054 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:55:45.745472 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733056 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733059 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733061 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733065 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733068 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733071 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733074 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733076 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733078 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733081 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733083 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733086 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733089 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733091 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733094 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733098 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733102 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733105 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733108 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:55:45.746088 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.733110 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.733117 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.741113 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.741139 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.741172 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.741180 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741271 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741280 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741285 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741290 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741295 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741300 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741304 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741309 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:55:45.746577 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741313 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741317 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741322 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741327 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741331 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741335 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741339 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741344 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741348 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741352 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741356 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741360 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741365 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741370 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741374 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741379 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741386 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741393 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741398 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741402 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:55:45.746994 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741406 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741411 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741415 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741420 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741424 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741429 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741433 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741437 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741442 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741446 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741451 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741455 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741460 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741464 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741468 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741473 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741477 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741481 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741485 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741489 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:55:45.747519 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741494 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741498 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741504 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741508 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741512 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741516 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741521 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741525 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741529 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741534 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741539 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741543 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741547 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741554 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741560 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741565 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741569 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741576 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741582 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741587 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:55:45.748074 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741591 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741596 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741600 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741605 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741610 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741615 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741619 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741624 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741629 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741633 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741638 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741642 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741646 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741650 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741654 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741659 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741664 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741668 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741672 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:55:45.748592 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741677 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741681 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.741686 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742136 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742143 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742147 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742153 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742157 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742162 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742166 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742170 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742174 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.742183 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742403 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742414 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:55:45.749390 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742419 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742425 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742430 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742435 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742439 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742444 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742448 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742453 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742457 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742461 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742465 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742472 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742476 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742480 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742485 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742489 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742493 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742498 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742502 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742506 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:55:45.750164 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742511 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742516 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742522 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742527 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742531 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742535 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742539 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742543 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742548 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742552 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742556 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742560 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742564 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742569 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742573 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742578 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742581 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742586 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742590 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742595 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:55:45.750814 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742598 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742603 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742607 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742613 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742619 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742624 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742628 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742632 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742636 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742640 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742645 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742649 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742653 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742658 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742663 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742668 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742672 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742676 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742681 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:55:45.751339 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742685 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742689 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742694 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742698 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742723 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742728 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742732 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742736 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742740 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742744 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742748 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742752 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742757 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742763 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742769 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742775 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742781 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742785 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742789 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:55:45.751859 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742793 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742798 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742802 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742806 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742810 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742814 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742819 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742823 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742827 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742833 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742837 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742841 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742846 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742850 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742854 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742858 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742862 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742867 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:55:45.752330 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:45.742871 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:55:45.752922 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.742879 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 22:55:45.752922 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.743063 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 22:55:45.752922 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.745734 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 22:55:45.752922 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.746950 2578 server.go:1019] "Starting client certificate rotation" Jul 10 22:55:45.752922 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.747051 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 22:55:45.752922 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.747094 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 22:55:45.752922 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.749426 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 22:55:45.752922 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.751091 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 22:55:45.761246 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.761222 2578 log.go:25] "Validated CRI v1 runtime API" Jul 10 22:55:45.763335 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.763315 2578 log.go:25] "Validated CRI v1 image API" Jul 10 22:55:45.764651 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.764629 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 22:55:45.766774 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.766754 2578 fs.go:135] Filesystem UUIDs: map[1e7cfbbe-4e42-439f-a3d5-358d4fdcf7a1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 af42b077-6a82-4391-977e-c06c30feade8:/dev/nvme0n1p4] Jul 10 22:55:45.766833 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.766774 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 22:55:45.772974 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.772855 2578 manager.go:216] Machine: {Timestamp:2026-07-10 22:55:45.771848164 +0000 UTC m=+0.268281035 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105154 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2adad5949a5323488da8b2dab09fc3 SystemUUID:ec2adad5-949a-5323-488d-a8b2dab09fc3 BootID:942cce30-dc02-4c84-a735-9d852d34b84f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6f:a4:1f:e1:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6f:a4:1f:e1:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:47:9c:01:46:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 22:55:45.772974 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.772969 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 22:55:45.773106 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.773094 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 22:55:45.773964 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.773936 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 22:55:45.774107 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.773967 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 22:55:45.774564 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.774554 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 22:55:45.774600 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.774568 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 22:55:45.774600 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.774575 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 22:55:45.775115 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.775104 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 22:55:45.775828 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.775811 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 22:55:45.776371 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.776361 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 22:55:45.780073 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.780060 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 10 22:55:45.780189 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.780180 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 22:55:45.780227 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.780210 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 10 22:55:45.780227 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.780220 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 22:55:45.780283 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.780234 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 22:55:45.780283 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.780243 2578 kubelet.go:398] "Adding apiserver pod source" Jul 10 22:55:45.780283 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.780251 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 22:55:45.780600 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.780587 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 22:55:45.780652 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.780610 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 22:55:45.783075 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.783051 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 22:55:45.784813 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.784799 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 22:55:45.784858 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.784830 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 22:55:45.784998 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.784987 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 22:55:45.785032 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785002 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 22:55:45.785032 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785009 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 22:55:45.785032 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785014 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 22:55:45.785032 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785022 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 22:55:45.785032 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785027 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 22:55:45.785402 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785393 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 22:55:45.785402 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785402 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 22:55:45.785457 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785410 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 22:55:45.785457 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785416 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 22:55:45.785457 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785424 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 22:55:45.785457 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.785432 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 22:55:45.786061 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.786052 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 22:55:45.786061 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.786061 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 22:55:45.789370 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.789211 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 22:55:45.789450 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.789250 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 22:55:45.789450 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.789303 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 22:55:45.789534 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.789527 2578 server.go:1268] "Started kubelet" Jul 10 22:55:45.789670 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.789617 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 22:55:45.789925 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.789632 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 22:55:45.790026 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.789840 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 22:55:45.790568 ip-10-0-135-146 systemd[1]: Started Kubernetes Kubelet. Jul 10 22:55:45.791211 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.791185 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 22:55:45.793020 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.793004 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 10 22:55:45.794957 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.794930 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gdw4s" Jul 10 22:55:45.796207 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.796185 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 22:55:45.797053 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.797036 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 22:55:45.797150 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.797094 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 22:55:45.797220 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.797176 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:45.797623 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.796876 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-146.ec2.internal.18c10fa8f711fdc6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-146.ec2.internal,UID:ip-10-0-135-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-146.ec2.internal,},FirstTimestamp:2026-07-10 22:55:45.78950087 +0000 UTC m=+0.285933742,LastTimestamp:2026-07-10 22:55:45.78950087 +0000 UTC m=+0.285933742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-146.ec2.internal,}" Jul 10 22:55:45.797752 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.797640 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 22:55:45.797752 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.797688 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 22:55:45.797752 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.797722 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 22:55:45.797903 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.797846 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 10 22:55:45.797903 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.797853 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 10 22:55:45.798076 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.798062 2578 factory.go:55] Registering systemd factory Jul 10 22:55:45.798117 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.798103 2578 factory.go:223] Registration of the systemd container factory successfully Jul 10 22:55:45.798468 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.798454 2578 factory.go:153] Registering CRI-O factory Jul 10 22:55:45.798507 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.798473 2578 factory.go:223] Registration of the crio container factory successfully Jul 10 22:55:45.798539 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.798519 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 22:55:45.798571 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.798543 2578 factory.go:103] Registering Raw factory Jul 10 22:55:45.798571 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.798561 2578 manager.go:1196] Started watching for new ooms in manager Jul 10 22:55:45.798986 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.798973 2578 manager.go:349] Starting recovery of all containers Jul 10 22:55:45.803047 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.802969 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 22:55:45.803047 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.803004 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gdw4s" Jul 10 22:55:45.803166 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.803103 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 22:55:45.810335 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.810313 2578 manager.go:354] Recovery completed Jul 10 22:55:45.814899 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.814887 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:55:45.816947 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.816931 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:55:45.817013 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.816961 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:55:45.817013 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.816972 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:55:45.818513 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.817792 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 22:55:45.818513 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.817810 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 22:55:45.818513 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.817815 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:55:45.818513 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.817833 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 10 22:55:45.818786 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.818766 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:55:45.818840 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.818805 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:55:45.818840 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.818820 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:55:45.818992 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.818917 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-146.ec2.internal.18c10fa8f8b4ccde default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-146.ec2.internal,UID:ip-10-0-135-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-146.ec2.internal,},FirstTimestamp:2026-07-10 22:55:45.816947934 +0000 UTC m=+0.313380805,LastTimestamp:2026-07-10 22:55:45.816947934 +0000 UTC m=+0.313380805,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-146.ec2.internal,}" Jul 10 22:55:45.820516 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.820503 2578 policy_none.go:49] "None policy: Start" Jul 10 22:55:45.820581 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.820520 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 22:55:45.820581 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.820530 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 22:55:45.822455 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.822443 2578 policy_none.go:47] "Start" Jul 10 22:55:45.866442 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.866417 2578 manager.go:337] "Starting Device Plugin manager" Jul 10 22:55:45.866599 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.866456 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 22:55:45.866599 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.866467 2578 server.go:87] "Starting device plugin registration server" Jul 10 22:55:45.866806 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.866791 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 22:55:45.866863 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.866809 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 22:55:45.866926 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.866902 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 22:55:45.867090 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.867071 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 22:55:45.867090 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.867085 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 22:55:45.867650 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.867627 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 22:55:45.867776 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.867678 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:45.940396 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.940353 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 22:55:45.942637 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.941802 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 22:55:45.942637 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.941850 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 22:55:45.942637 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.941876 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 22:55:45.942637 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.941919 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 22:55:45.944292 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.944269 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:55:45.967388 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.967359 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:55:45.968564 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.968545 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:55:45.968666 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.968578 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:55:45.968666 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.968588 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:55:45.968666 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.968612 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-146.ec2.internal" Jul 10 22:55:45.977042 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:45.976992 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-146.ec2.internal" Jul 10 22:55:45.977042 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.977020 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-146.ec2.internal\": node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:45.990402 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:45.990371 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:46.042301 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.042269 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal"] Jul 10 22:55:46.042398 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.042367 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:55:46.043386 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.043364 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:55:46.043468 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.043398 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:55:46.043468 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.043408 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:55:46.045716 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.045694 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:55:46.045826 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.045810 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.045863 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.045849 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:55:46.046521 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.046504 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:55:46.046588 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.046537 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:55:46.046588 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.046553 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:55:46.046588 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.046555 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:55:46.046588 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.046573 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:55:46.046588 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.046583 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:55:46.048847 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.048831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.048891 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.048867 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:55:46.049657 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.049640 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:55:46.049752 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.049675 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:55:46.049752 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.049688 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:55:46.078597 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.078567 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-146.ec2.internal\" not found" node="ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.083037 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.083018 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-146.ec2.internal\" not found" node="ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.091082 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.091059 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:46.098657 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.098636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d580faeff671e00cc2334681f3adf444-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal\" (UID: \"d580faeff671e00cc2334681f3adf444\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.098738 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.098664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d580faeff671e00cc2334681f3adf444-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal\" (UID: \"d580faeff671e00cc2334681f3adf444\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.098738 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.098682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c12fda927766b31b44f06f34ca2f545-config\") pod \"kube-apiserver-proxy-ip-10-0-135-146.ec2.internal\" (UID: \"4c12fda927766b31b44f06f34ca2f545\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.191439 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.191409 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:46.199797 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.199763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d580faeff671e00cc2334681f3adf444-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal\" (UID: \"d580faeff671e00cc2334681f3adf444\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.199845 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.199804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d580faeff671e00cc2334681f3adf444-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal\" (UID: \"d580faeff671e00cc2334681f3adf444\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.199845 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.199827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c12fda927766b31b44f06f34ca2f545-config\") pod \"kube-apiserver-proxy-ip-10-0-135-146.ec2.internal\" (UID: \"4c12fda927766b31b44f06f34ca2f545\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.199911 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.199860 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c12fda927766b31b44f06f34ca2f545-config\") pod \"kube-apiserver-proxy-ip-10-0-135-146.ec2.internal\" (UID: \"4c12fda927766b31b44f06f34ca2f545\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.199911 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.199861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d580faeff671e00cc2334681f3adf444-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal\" (UID: \"d580faeff671e00cc2334681f3adf444\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.199911 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.199885 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d580faeff671e00cc2334681f3adf444-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal\" (UID: \"d580faeff671e00cc2334681f3adf444\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.292235 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.292201 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:46.380843 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.380804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.386000 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.385888 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.392508 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.392488 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:46.493140 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.493097 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:46.593761 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.593663 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:46.694264 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.694216 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:46.746283 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.746241 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 22:55:46.746927 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.746399 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 22:55:46.795244 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:46.795214 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-146.ec2.internal\" not found" Jul 10 22:55:46.808422 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.808362 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 22:50:46 +0000 UTC" deadline="2028-01-17 22:22:29.289381124 +0000 UTC" Jul 10 22:55:46.808422 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.808413 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13343h26m42.480974045s" Jul 10 22:55:46.814854 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.814829 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:55:46.848127 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.848032 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:55:46.898176 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.898150 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.909245 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.909216 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 22:55:46.910853 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.910835 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal" Jul 10 22:55:46.921402 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.921378 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 22:55:46.963915 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:46.963879 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd580faeff671e00cc2334681f3adf444.slice/crio-a023a783a686522dfd225492982bcbe5a9bba24ffd2814c76d0c46ea87677640 WatchSource:0}: Error finding container a023a783a686522dfd225492982bcbe5a9bba24ffd2814c76d0c46ea87677640: Status 404 returned error can't find the container with id a023a783a686522dfd225492982bcbe5a9bba24ffd2814c76d0c46ea87677640 Jul 10 22:55:46.970889 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:46.970869 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 22:55:46.978514 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:46.978468 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c12fda927766b31b44f06f34ca2f545.slice/crio-f91ae618116cba5cd7480e96a51d082ec7e07dfe92be357b861e0db637073621 WatchSource:0}: Error finding container f91ae618116cba5cd7480e96a51d082ec7e07dfe92be357b861e0db637073621: Status 404 returned error can't find the container with id f91ae618116cba5cd7480e96a51d082ec7e07dfe92be357b861e0db637073621 Jul 10 22:55:47.173033 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.172937 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:55:47.781916 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.781873 2578 apiserver.go:52] "Watching apiserver" Jul 10 22:55:47.789425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.789396 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 22:55:47.790018 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.789989 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-zktgk","openshift-network-diagnostics/network-check-target-p7rg7","openshift-network-operator/iptables-alerter-5k569","kube-system/global-pull-secret-syncer-7zvwb","kube-system/konnectivity-agent-mh4v2","openshift-cluster-node-tuning-operator/tuned-n6dbg","openshift-dns/node-resolver-jg9xc","openshift-image-registry/node-ca-s56qh","openshift-ovn-kubernetes/ovnkube-node-k8ldq","kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal","openshift-multus/multus-additional-cni-plugins-tw8tv","openshift-multus/multus-lnhpt"] Jul 10 22:55:47.792925 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.792898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.795409 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.795383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8gszv\"" Jul 10 22:55:47.795519 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.795471 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 22:55:47.795709 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.795690 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 22:55:47.797032 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.797009 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.798164 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.798145 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 22:55:47.801349 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.799336 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 22:55:47.801349 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.801127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.801349 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.801197 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 22:55:47.804251 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.802212 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xhgt2\"" Jul 10 22:55:47.804251 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.802852 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 22:55:47.804251 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.803087 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 22:55:47.804251 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.803832 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 22:55:47.804251 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.804018 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 22:55:47.806185 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.805126 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vb4r4\"" Jul 10 22:55:47.807232 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.807165 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 22:55:47.809452 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.809423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a901a703-a86b-44f3-97a6-2081fda5042d-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.809536 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.809490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a901a703-a86b-44f3-97a6-2081fda5042d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.809536 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.809517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76386443-600f-4203-9262-9d5b3465cb66-hosts-file\") pod \"node-resolver-jg9xc\" (UID: \"76386443-600f-4203-9262-9d5b3465cb66\") " pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.809626 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.809541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9j44\" (UniqueName: \"kubernetes.io/projected/3b57058c-d6c3-42d8-a160-876e091c5b4c-kube-api-access-s9j44\") pod \"iptables-alerter-5k569\" (UID: \"3b57058c-d6c3-42d8-a160-876e091c5b4c\") " pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.809626 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.809570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-system-cni-dir\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.809626 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.809592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.809900 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.809884 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 22:55:47.810041 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.810021 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:47.810118 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.810044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzl5t\" (UniqueName: \"kubernetes.io/projected/a901a703-a86b-44f3-97a6-2081fda5042d-kube-api-access-hzl5t\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.810118 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.810102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwr5b\" (UniqueName: \"kubernetes.io/projected/76386443-600f-4203-9262-9d5b3465cb66-kube-api-access-lwr5b\") pod \"node-resolver-jg9xc\" (UID: \"76386443-600f-4203-9262-9d5b3465cb66\") " pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.810226 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.810136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-os-release\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.810226 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:47.810138 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:55:47.810226 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.810160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a901a703-a86b-44f3-97a6-2081fda5042d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.810226 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.810184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b57058c-d6c3-42d8-a160-876e091c5b4c-iptables-alerter-script\") pod \"iptables-alerter-5k569\" (UID: \"3b57058c-d6c3-42d8-a160-876e091c5b4c\") " pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.810442 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.810242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b57058c-d6c3-42d8-a160-876e091c5b4c-host-slash\") pod \"iptables-alerter-5k569\" (UID: \"3b57058c-d6c3-42d8-a160-876e091c5b4c\") " pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.810442 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.810270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76386443-600f-4203-9262-9d5b3465cb66-tmp-dir\") pod \"node-resolver-jg9xc\" (UID: \"76386443-600f-4203-9262-9d5b3465cb66\") " pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.810442 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.810296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-cnibin\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.812268 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.812248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:55:47.812665 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.812638 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 22:55:47.814638 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.814619 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-km6fw\"" Jul 10 22:55:47.814957 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.814859 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 22:55:47.815036 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.815014 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 22:55:47.815154 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.815136 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.817355 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.817331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.819452 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.819421 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hhmqg\"" Jul 10 22:55:47.819742 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.819703 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 22:55:47.820015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.819995 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 22:55:47.820607 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.820586 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:47.820701 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.820610 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 22:55:47.820701 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:47.820674 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:55:47.820836 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.820766 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 22:55:47.820959 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.820937 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 22:55:47.821024 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.820976 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 22:55:47.821131 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.821116 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 22:55:47.821187 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.821148 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6tbfw\"" Jul 10 22:55:47.821372 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.821355 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 22:55:47.822919 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.822895 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:47.823031 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:47.823004 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:55:47.826526 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.825527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.827836 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.827771 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 22:55:47.827836 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.827814 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mxr9s\"" Jul 10 22:55:47.828914 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.828631 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:47.831642 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.830912 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:47.831642 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.831230 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 22:55:47.831642 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.831266 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 22:55:47.831642 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.831414 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 22:55:47.831642 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.831536 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m7gtr\"" Jul 10 22:55:47.833508 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.833491 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pbg2w\"" Jul 10 22:55:47.833670 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.833646 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5xmnx" Jul 10 22:55:47.833968 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.833943 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 22:55:47.834217 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.834197 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 22:55:47.834651 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.834634 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 22:55:47.842102 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.842045 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5xmnx" Jul 10 22:55:47.899655 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.899620 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 22:55:47.910879 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.910840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-host\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.910879 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.910888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-var-lib-openvswitch\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.910914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-ovnkube-config\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.910934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-ovn-node-metrics-cert\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.910960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-cni-dir\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.910981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-os-release\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-socket-dir-parent\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-var-lib-kubelet\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9j44\" (UniqueName: \"kubernetes.io/projected/3b57058c-d6c3-42d8-a160-876e091c5b4c-kube-api-access-s9j44\") pod \"iptables-alerter-5k569\" (UID: \"3b57058c-d6c3-42d8-a160-876e091c5b4c\") " pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzl5t\" (UniqueName: \"kubernetes.io/projected/a901a703-a86b-44f3-97a6-2081fda5042d-kube-api-access-hzl5t\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dabca611-e058-4d83-9c92-020a594e5d88-dbus\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:47.911156 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-hostroot\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g85rm\" (UniqueName: \"kubernetes.io/projected/54b04330-58f8-4df4-9ba2-79950539353f-kube-api-access-g85rm\") pod \"node-ca-s56qh\" (UID: \"54b04330-58f8-4df4-9ba2-79950539353f\") " pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b57058c-d6c3-42d8-a160-876e091c5b4c-iptables-alerter-script\") pod \"iptables-alerter-5k569\" (UID: \"3b57058c-d6c3-42d8-a160-876e091c5b4c\") " pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-systemd\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-sys\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a483e306-3800-43c2-9802-6469e1f01881-etc-tuned\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-cni-netd\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-daemon-config\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54b04330-58f8-4df4-9ba2-79950539353f-host\") pod \"node-ca-s56qh\" (UID: \"54b04330-58f8-4df4-9ba2-79950539353f\") " pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a901a703-a86b-44f3-97a6-2081fda5042d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-sysconfig\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.911698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-sysctl-conf\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.911850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-run\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-slash\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-run-ovn\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-cni-bin\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912108 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3b57058c-d6c3-42d8-a160-876e091c5b4c-iptables-alerter-script\") pod \"iptables-alerter-5k569\" (UID: \"3b57058c-d6c3-42d8-a160-876e091c5b4c\") " pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-system-cni-dir\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-run-systemd\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-etc-openvswitch\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-socket-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dabca611-e058-4d83-9c92-020a594e5d88-kubelet-config\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54b04330-58f8-4df4-9ba2-79950539353f-serviceca\") pod \"node-ca-s56qh\" (UID: \"54b04330-58f8-4df4-9ba2-79950539353f\") " pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/137634da-e1b2-4e22-8edd-4c2c7589d04e-agent-certs\") pod \"konnectivity-agent-mh4v2\" (UID: \"137634da-e1b2-4e22-8edd-4c2c7589d04e\") " pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:47.912425 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a901a703-a86b-44f3-97a6-2081fda5042d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76386443-600f-4203-9262-9d5b3465cb66-tmp-dir\") pod \"node-resolver-jg9xc\" (UID: \"76386443-600f-4203-9262-9d5b3465cb66\") " pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-cnibin\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-cnibin\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-var-lib-cni-multus\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912610 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-cnibin\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-etc-kubernetes\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76386443-600f-4203-9262-9d5b3465cb66-hosts-file\") pod \"node-resolver-jg9xc\" (UID: \"76386443-600f-4203-9262-9d5b3465cb66\") " pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912690 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a901a703-a86b-44f3-97a6-2081fda5042d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-run-k8s-cni-cncf-io\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-lib-modules\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwr5b\" (UniqueName: \"kubernetes.io/projected/76386443-600f-4203-9262-9d5b3465cb66-kube-api-access-lwr5b\") pod \"node-resolver-jg9xc\" (UID: \"76386443-600f-4203-9262-9d5b3465cb66\") " pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-systemd-units\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912813 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76386443-600f-4203-9262-9d5b3465cb66-hosts-file\") pod \"node-resolver-jg9xc\" (UID: \"76386443-600f-4203-9262-9d5b3465cb66\") " pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-registration-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-run-multus-certs\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.913257 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvp7m\" (UniqueName: \"kubernetes.io/projected/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-kube-api-access-gvp7m\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/137634da-e1b2-4e22-8edd-4c2c7589d04e-konnectivity-ca\") pod \"konnectivity-agent-mh4v2\" (UID: \"137634da-e1b2-4e22-8edd-4c2c7589d04e\") " pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-var-lib-kubelet\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912903 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76386443-600f-4203-9262-9d5b3465cb66-tmp-dir\") pod \"node-resolver-jg9xc\" (UID: \"76386443-600f-4203-9262-9d5b3465cb66\") " pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a483e306-3800-43c2-9802-6469e1f01881-tmp\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxl59\" (UniqueName: \"kubernetes.io/projected/a483e306-3800-43c2-9802-6469e1f01881-kube-api-access-kxl59\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-env-overrides\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.912982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8p4w\" (UniqueName: \"kubernetes.io/projected/b5ce1504-fb11-433e-b899-c6227ba9ea44-kube-api-access-v8p4w\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-run-netns\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913099 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a901a703-a86b-44f3-97a6-2081fda5042d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-run-netns\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-cni-binary-copy\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.914286 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-system-cni-dir\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913316 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-system-cni-dir\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-modprobe-d\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-run-openvswitch\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-node-log\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-log-socket\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-etc-selinux\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng9lr\" (UniqueName: \"kubernetes.io/projected/3c7063b8-b242-45ff-a6b2-342d66a4cc64-kube-api-access-ng9lr\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-os-release\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b57058c-d6c3-42d8-a160-876e091c5b4c-host-slash\") pod \"iptables-alerter-5k569\" (UID: \"3b57058c-d6c3-42d8-a160-876e091c5b4c\") " pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-kubernetes\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-sysctl-d\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913659 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b57058c-d6c3-42d8-a160-876e091c5b4c-host-slash\") pod \"iptables-alerter-5k569\" (UID: \"3b57058c-d6c3-42d8-a160-876e091c5b4c\") " pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913674 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a901a703-a86b-44f3-97a6-2081fda5042d-os-release\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.915195 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdc64\" (UniqueName: \"kubernetes.io/projected/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-kube-api-access-tdc64\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.916089 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-device-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:47.916089 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-sys-fs\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:47.916089 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-var-lib-cni-bin\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.916089 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a901a703-a86b-44f3-97a6-2081fda5042d-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.916089 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-kubelet\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.916089 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-ovnkube-script-lib\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:47.916089 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.913966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-conf-dir\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:47.916089 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.914391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a901a703-a86b-44f3-97a6-2081fda5042d-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.919276 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.919241 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 22:55:47.925115 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.924573 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9j44\" (UniqueName: \"kubernetes.io/projected/3b57058c-d6c3-42d8-a160-876e091c5b4c-kube-api-access-s9j44\") pod \"iptables-alerter-5k569\" (UID: \"3b57058c-d6c3-42d8-a160-876e091c5b4c\") " pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:47.925115 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.924586 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwr5b\" (UniqueName: \"kubernetes.io/projected/76386443-600f-4203-9262-9d5b3465cb66-kube-api-access-lwr5b\") pod \"node-resolver-jg9xc\" (UID: \"76386443-600f-4203-9262-9d5b3465cb66\") " pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:47.925115 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.925068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzl5t\" (UniqueName: \"kubernetes.io/projected/a901a703-a86b-44f3-97a6-2081fda5042d-kube-api-access-hzl5t\") pod \"multus-additional-cni-plugins-tw8tv\" (UID: \"a901a703-a86b-44f3-97a6-2081fda5042d\") " pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:47.949135 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.949069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal" event={"ID":"4c12fda927766b31b44f06f34ca2f545","Type":"ContainerStarted","Data":"f91ae618116cba5cd7480e96a51d082ec7e07dfe92be357b861e0db637073621"} Jul 10 22:55:47.951289 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:47.951213 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" event={"ID":"d580faeff671e00cc2334681f3adf444","Type":"ContainerStarted","Data":"a023a783a686522dfd225492982bcbe5a9bba24ffd2814c76d0c46ea87677640"} Jul 10 22:55:48.014266 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-conf-dir\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014481 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-host\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.014481 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-var-lib-openvswitch\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.014481 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-ovnkube-config\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.014481 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014338 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-conf-dir\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014481 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-ovn-node-metrics-cert\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.014481 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-host\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.014481 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-cni-dir\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014481 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014425 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-var-lib-openvswitch\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014514 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-cni-dir\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-os-release\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-socket-dir-parent\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-var-lib-kubelet\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dabca611-e058-4d83-9c92-020a594e5d88-dbus\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-hostroot\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g85rm\" (UniqueName: \"kubernetes.io/projected/54b04330-58f8-4df4-9ba2-79950539353f-kube-api-access-g85rm\") pod \"node-ca-s56qh\" (UID: \"54b04330-58f8-4df4-9ba2-79950539353f\") " pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-systemd\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-sys\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a483e306-3800-43c2-9802-6469e1f01881-etc-tuned\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-cni-netd\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-daemon-config\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54b04330-58f8-4df4-9ba2-79950539353f-host\") pod \"node-ca-s56qh\" (UID: \"54b04330-58f8-4df4-9ba2-79950539353f\") " pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-sysconfig\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-hostroot\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.014995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.014982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-sysctl-conf\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-run\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-slash\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-run-ovn\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015073 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-socket-dir-parent\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-cni-bin\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015100 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-var-lib-kubelet\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-system-cni-dir\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-run-systemd\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-etc-openvswitch\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-socket-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015211 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dabca611-e058-4d83-9c92-020a594e5d88-dbus\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dabca611-e058-4d83-9c92-020a594e5d88-kubelet-config\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015232 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-sysconfig\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54b04330-58f8-4df4-9ba2-79950539353f-serviceca\") pod \"node-ca-s56qh\" (UID: \"54b04330-58f8-4df4-9ba2-79950539353f\") " pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/137634da-e1b2-4e22-8edd-4c2c7589d04e-agent-certs\") pod \"konnectivity-agent-mh4v2\" (UID: \"137634da-e1b2-4e22-8edd-4c2c7589d04e\") " pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54b04330-58f8-4df4-9ba2-79950539353f-host\") pod \"node-ca-s56qh\" (UID: \"54b04330-58f8-4df4-9ba2-79950539353f\") " pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:48.015918 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015365 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-system-cni-dir\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015377 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-run-systemd\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-etc-openvswitch\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-cnibin\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-var-lib-cni-multus\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-etc-kubernetes\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-socket-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-run-k8s-cni-cncf-io\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dabca611-e058-4d83-9c92-020a594e5d88-kubelet-config\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-lib-modules\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-systemd-units\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-registration-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-run-multus-certs\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvp7m\" (UniqueName: \"kubernetes.io/projected/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-kube-api-access-gvp7m\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/137634da-e1b2-4e22-8edd-4c2c7589d04e-konnectivity-ca\") pod \"konnectivity-agent-mh4v2\" (UID: \"137634da-e1b2-4e22-8edd-4c2c7589d04e\") " pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-var-lib-kubelet\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.016945 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a483e306-3800-43c2-9802-6469e1f01881-tmp\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxl59\" (UniqueName: \"kubernetes.io/projected/a483e306-3800-43c2-9802-6469e1f01881-kube-api-access-kxl59\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-env-overrides\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8p4w\" (UniqueName: \"kubernetes.io/projected/b5ce1504-fb11-433e-b899-c6227ba9ea44-kube-api-access-v8p4w\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-run-netns\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015914 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-run-netns\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-cni-binary-copy\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-modprobe-d\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-run-openvswitch\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-node-log\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-log-socket\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016165 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-multus-daemon-config\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-etc-selinux\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.017971 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9lr\" (UniqueName: \"kubernetes.io/projected/3c7063b8-b242-45ff-a6b2-342d66a4cc64-kube-api-access-ng9lr\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-kubernetes\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-sysctl-d\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016325 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-ovnkube-config\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdc64\" (UniqueName: \"kubernetes.io/projected/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-kube-api-access-tdc64\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-device-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016591 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-sys-fs\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-slash\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-run-ovn\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-var-lib-cni-bin\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-kubelet\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-cnibin\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-ovnkube-script-lib\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016773 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-var-lib-cni-multus\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016380 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-sysctl-conf\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016870 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-run-k8s-cni-cncf-io\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.019015 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016248 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-etc-selinux\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016896 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-systemd\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.017210 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-run-netns\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.017297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.017326 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-ovnkube-script-lib\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.017445 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-device-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016428 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-run\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.017548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-sys-fs\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.017558 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.017599 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-var-lib-cni-bin\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016551 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.017647 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:48.517623568 +0000 UTC m=+3.014056459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.017879 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-kubelet\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016545 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-cni-bin\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.017961 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-run-openvswitch\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-node-log\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018126 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-var-lib-kubelet\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018111 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54b04330-58f8-4df4-9ba2-79950539353f-serviceca\") pod \"node-ca-s56qh\" (UID: \"54b04330-58f8-4df4-9ba2-79950539353f\") " pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:48.020055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-sys\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018239 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-systemd-units\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018244 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-run-multus-certs\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018316 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-kubernetes\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018456 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-sysctl-d\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018578 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-cni-binary-copy\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.016837 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-etc-kubernetes\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018718 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-etc-modprobe-d\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018724 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/137634da-e1b2-4e22-8edd-4c2c7589d04e-konnectivity-ca\") pod \"konnectivity-agent-mh4v2\" (UID: \"137634da-e1b2-4e22-8edd-4c2c7589d04e\") " pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018812 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-log-socket\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018813 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-registration-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.018909 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.018899 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b5ce1504-fb11-433e-b899-c6227ba9ea44-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.020361 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret podName:dabca611-e058-4d83-9c92-020a594e5d88 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:48.520328542 +0000 UTC m=+3.016761418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret") pod "global-pull-secret-syncer-7zvwb" (UID: "dabca611-e058-4d83-9c92-020a594e5d88") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.020706 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-ovn-node-metrics-cert\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.020765 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-host-run-netns\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.021151 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-env-overrides\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.021205 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.015044 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-os-release\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.022322 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.021276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a483e306-3800-43c2-9802-6469e1f01881-lib-modules\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.022322 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.021323 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-host-cni-netd\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.022322 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.022181 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a483e306-3800-43c2-9802-6469e1f01881-tmp\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.022322 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.022225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a483e306-3800-43c2-9802-6469e1f01881-etc-tuned\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.024235 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.024211 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:55:48.024383 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.024239 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:55:48.024383 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.024270 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2qrtw for pod openshift-network-diagnostics/network-check-target-p7rg7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:48.024383 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.024351 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw podName:4f32dadb-dfb4-47ae-9d29-03999a2709d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:48.524332957 +0000 UTC m=+3.020765832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2qrtw" (UniqueName: "kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw") pod "network-check-target-p7rg7" (UID: "4f32dadb-dfb4-47ae-9d29-03999a2709d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:48.025698 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.025671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/137634da-e1b2-4e22-8edd-4c2c7589d04e-agent-certs\") pod \"konnectivity-agent-mh4v2\" (UID: \"137634da-e1b2-4e22-8edd-4c2c7589d04e\") " pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:55:48.028998 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.028968 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxl59\" (UniqueName: \"kubernetes.io/projected/a483e306-3800-43c2-9802-6469e1f01881-kube-api-access-kxl59\") pod \"tuned-n6dbg\" (UID: \"a483e306-3800-43c2-9802-6469e1f01881\") " pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.029413 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.029236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdc64\" (UniqueName: \"kubernetes.io/projected/6ead4faf-1e4b-4c26-bc9c-62b3067b0352-kube-api-access-tdc64\") pod \"ovnkube-node-k8ldq\" (UID: \"6ead4faf-1e4b-4c26-bc9c-62b3067b0352\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.029758 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.029729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvp7m\" (UniqueName: \"kubernetes.io/projected/88ebfcba-80ce-4fb6-83b5-a4ee524cbef0-kube-api-access-gvp7m\") pod \"multus-lnhpt\" (UID: \"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0\") " pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.030467 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.030440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng9lr\" (UniqueName: \"kubernetes.io/projected/3c7063b8-b242-45ff-a6b2-342d66a4cc64-kube-api-access-ng9lr\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:48.031360 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.031299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8p4w\" (UniqueName: \"kubernetes.io/projected/b5ce1504-fb11-433e-b899-c6227ba9ea44-kube-api-access-v8p4w\") pod \"aws-ebs-csi-driver-node-q47vd\" (UID: \"b5ce1504-fb11-433e-b899-c6227ba9ea44\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.032039 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.031971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g85rm\" (UniqueName: \"kubernetes.io/projected/54b04330-58f8-4df4-9ba2-79950539353f-kube-api-access-g85rm\") pod \"node-ca-s56qh\" (UID: \"54b04330-58f8-4df4-9ba2-79950539353f\") " pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:48.120314 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.120273 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jg9xc" Jul 10 22:55:48.129029 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.128991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" Jul 10 22:55:48.144415 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.144377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5k569" Jul 10 22:55:48.152532 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.152504 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s56qh" Jul 10 22:55:48.160843 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.160815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:55:48.174127 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.174099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" Jul 10 22:55:48.187506 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.187471 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:55:48.195775 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.195740 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lnhpt" Jul 10 22:55:48.203087 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.203057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" Jul 10 22:55:48.521130 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.521087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:48.521348 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.521174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:48.521348 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.521269 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:48.521348 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.521284 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:48.521498 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.521362 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:49.521337181 +0000 UTC m=+4.017770042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:48.521498 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.521384 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret podName:dabca611-e058-4d83-9c92-020a594e5d88 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:49.521376922 +0000 UTC m=+4.017809783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret") pod "global-pull-secret-syncer-7zvwb" (UID: "dabca611-e058-4d83-9c92-020a594e5d88") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:48.622033 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.621985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:48.622237 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.622145 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:55:48.622237 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.622170 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:55:48.622237 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.622183 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2qrtw for pod openshift-network-diagnostics/network-check-target-p7rg7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:48.622384 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.622296 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw podName:4f32dadb-dfb4-47ae-9d29-03999a2709d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:49.62227602 +0000 UTC m=+4.118708885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qrtw" (UniqueName: "kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw") pod "network-check-target-p7rg7" (UID: "4f32dadb-dfb4-47ae-9d29-03999a2709d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:48.845658 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.845598 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 22:50:48 +0000 UTC" deadline="2028-04-03 21:34:20.611695256 +0000 UTC" Jul 10 22:55:48.845658 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.845653 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15190h38m31.766045214s" Jul 10 22:55:48.942762 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:48.942714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:48.942976 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:48.942851 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:55:49.098813 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:49.098779 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ebfcba_80ce_4fb6_83b5_a4ee524cbef0.slice/crio-5b9b1e7b2b798de0604fe4e3afd529ef14d1549c356124ff332b5d1459ac4e10 WatchSource:0}: Error finding container 5b9b1e7b2b798de0604fe4e3afd529ef14d1549c356124ff332b5d1459ac4e10: Status 404 returned error can't find the container with id 5b9b1e7b2b798de0604fe4e3afd529ef14d1549c356124ff332b5d1459ac4e10 Jul 10 22:55:49.102269 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:49.102200 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda483e306_3800_43c2_9802_6469e1f01881.slice/crio-cf23be03c8c09d1c5883475193fbf0f0f8388b09676bab27ffb88cdab4f39498 WatchSource:0}: Error finding container cf23be03c8c09d1c5883475193fbf0f0f8388b09676bab27ffb88cdab4f39498: Status 404 returned error can't find the container with id cf23be03c8c09d1c5883475193fbf0f0f8388b09676bab27ffb88cdab4f39498 Jul 10 22:55:49.104988 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:49.104959 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76386443_600f_4203_9262_9d5b3465cb66.slice/crio-ee271b027ef849c3c65d5d385650201458f186a28107b1aeae0229160d2c7986 WatchSource:0}: Error finding container ee271b027ef849c3c65d5d385650201458f186a28107b1aeae0229160d2c7986: Status 404 returned error can't find the container with id ee271b027ef849c3c65d5d385650201458f186a28107b1aeae0229160d2c7986 Jul 10 22:55:49.106430 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:49.106405 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ead4faf_1e4b_4c26_bc9c_62b3067b0352.slice/crio-6a57c16f618bcd00b67c8efcf0487ebe916b63b2d1232472044c9c60fbdbccf8 WatchSource:0}: Error finding container 6a57c16f618bcd00b67c8efcf0487ebe916b63b2d1232472044c9c60fbdbccf8: Status 404 returned error can't find the container with id 6a57c16f618bcd00b67c8efcf0487ebe916b63b2d1232472044c9c60fbdbccf8 Jul 10 22:55:49.107914 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:55:49.107882 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137634da_e1b2_4e22_8edd_4c2c7589d04e.slice/crio-b623aed0c51e3448b0a6e7d5865fbc0ef793f442866bee3d615a38f14a2cee76 WatchSource:0}: Error finding container b623aed0c51e3448b0a6e7d5865fbc0ef793f442866bee3d615a38f14a2cee76: Status 404 returned error can't find the container with id b623aed0c51e3448b0a6e7d5865fbc0ef793f442866bee3d615a38f14a2cee76 Jul 10 22:55:49.529522 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.529477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:49.529758 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.529564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:49.529758 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.529708 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:49.529897 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.529794 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:51.529772334 +0000 UTC m=+6.026205194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:49.529897 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.529861 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:49.530008 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.529911 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret podName:dabca611-e058-4d83-9c92-020a594e5d88 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:51.529896192 +0000 UTC m=+6.026329071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret") pod "global-pull-secret-syncer-7zvwb" (UID: "dabca611-e058-4d83-9c92-020a594e5d88") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:49.630681 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.630578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:49.630879 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.630813 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:55:49.630879 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.630837 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:55:49.630879 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.630865 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2qrtw for pod openshift-network-diagnostics/network-check-target-p7rg7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:49.631056 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.630932 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw podName:4f32dadb-dfb4-47ae-9d29-03999a2709d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:51.630910522 +0000 UTC m=+6.127343384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qrtw" (UniqueName: "kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw") pod "network-check-target-p7rg7" (UID: "4f32dadb-dfb4-47ae-9d29-03999a2709d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:49.847007 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.846923 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 22:50:48 +0000 UTC" deadline="2028-02-20 13:08:31.421705903 +0000 UTC" Jul 10 22:55:49.847007 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.846970 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14150h12m41.574740657s" Jul 10 22:55:49.944113 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.942245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:49.944113 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.942422 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:55:49.944113 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.943876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:49.944113 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:49.944010 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:55:49.964588 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.964476 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" event={"ID":"b5ce1504-fb11-433e-b899-c6227ba9ea44","Type":"ContainerStarted","Data":"616549ff463509f5814dfa3a284e806d9009d6d91321b78235efab04c7b151d0"} Jul 10 22:55:49.979983 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.979928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mh4v2" event={"ID":"137634da-e1b2-4e22-8edd-4c2c7589d04e","Type":"ContainerStarted","Data":"b623aed0c51e3448b0a6e7d5865fbc0ef793f442866bee3d615a38f14a2cee76"} Jul 10 22:55:49.988057 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.988015 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerStarted","Data":"6a57c16f618bcd00b67c8efcf0487ebe916b63b2d1232472044c9c60fbdbccf8"} Jul 10 22:55:49.999307 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:49.999264 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lnhpt" event={"ID":"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0","Type":"ContainerStarted","Data":"5b9b1e7b2b798de0604fe4e3afd529ef14d1549c356124ff332b5d1459ac4e10"} Jul 10 22:55:50.005553 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.005511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal" event={"ID":"4c12fda927766b31b44f06f34ca2f545","Type":"ContainerStarted","Data":"5949c68ee7e74a6e81ba16c5525335fd91fc016ad00957d37ae9935eaab687c2"} Jul 10 22:55:50.015670 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.015630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" event={"ID":"a901a703-a86b-44f3-97a6-2081fda5042d","Type":"ContainerStarted","Data":"3b20c52dabc9458d8583089f2c7dd9035df85878c4f4657c3c6a5c28218c6dd7"} Jul 10 22:55:50.023913 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.023869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s56qh" event={"ID":"54b04330-58f8-4df4-9ba2-79950539353f","Type":"ContainerStarted","Data":"353d335c27cde2077ec5d154fbb5ee4380f469b782e71d8697789173a10cca71"} Jul 10 22:55:50.035293 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.035255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jg9xc" event={"ID":"76386443-600f-4203-9262-9d5b3465cb66","Type":"ContainerStarted","Data":"ee271b027ef849c3c65d5d385650201458f186a28107b1aeae0229160d2c7986"} Jul 10 22:55:50.039578 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.039545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" event={"ID":"a483e306-3800-43c2-9802-6469e1f01881","Type":"ContainerStarted","Data":"cf23be03c8c09d1c5883475193fbf0f0f8388b09676bab27ffb88cdab4f39498"} Jul 10 22:55:50.046887 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.046842 2578 generic.go:356] "Generic (PLEG): container finished" podID="d580faeff671e00cc2334681f3adf444" containerID="913129dd64d8e52ca51ca63fe06ff62d0947d85cb0e8221d06a2c7b3a6e9675e" exitCode=0 Jul 10 22:55:50.047037 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.046949 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" event={"ID":"d580faeff671e00cc2334681f3adf444","Type":"ContainerDied","Data":"913129dd64d8e52ca51ca63fe06ff62d0947d85cb0e8221d06a2c7b3a6e9675e"} Jul 10 22:55:50.053380 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.053347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5k569" event={"ID":"3b57058c-d6c3-42d8-a160-876e091c5b4c","Type":"ContainerStarted","Data":"b5fdb2fa14c1708ed98135e1dcc4486441cd47dbfa6d60e5ac3ceab33c482edc"} Jul 10 22:55:50.063907 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.063849 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-146.ec2.internal" podStartSLOduration=3.063824965 podStartE2EDuration="3.063824965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:55:50.02246178 +0000 UTC m=+4.518894664" watchObservedRunningTime="2026-07-10 22:55:50.063824965 +0000 UTC m=+4.560257845" Jul 10 22:55:50.943121 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:50.942583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:50.943121 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:50.942761 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:55:51.072305 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:51.072265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" event={"ID":"d580faeff671e00cc2334681f3adf444","Type":"ContainerStarted","Data":"775583ea8d8d68d6a3fb88820ead05c5febea693bd8de9260be391e3eed06d00"} Jul 10 22:55:51.548859 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:51.548795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:51.549049 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:51.548902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:51.549049 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.549027 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:51.549169 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.549094 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret podName:dabca611-e058-4d83-9c92-020a594e5d88 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:55.549072201 +0000 UTC m=+10.045505060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret") pod "global-pull-secret-syncer-7zvwb" (UID: "dabca611-e058-4d83-9c92-020a594e5d88") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:51.549508 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.549484 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:51.549612 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.549546 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:55.549529457 +0000 UTC m=+10.045962316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:51.650117 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:51.650075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:51.650331 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.650306 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:55:51.650418 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.650343 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:55:51.650418 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.650359 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2qrtw for pod openshift-network-diagnostics/network-check-target-p7rg7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:51.650541 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.650430 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw podName:4f32dadb-dfb4-47ae-9d29-03999a2709d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:55.650402262 +0000 UTC m=+10.146835120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qrtw" (UniqueName: "kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw") pod "network-check-target-p7rg7" (UID: "4f32dadb-dfb4-47ae-9d29-03999a2709d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:51.942928 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:51.942848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:51.943115 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.942989 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:55:51.943843 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:51.943817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:51.944229 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:51.943942 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:55:52.942406 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:52.942365 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:52.942580 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:52.942493 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:55:53.944922 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:53.944851 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:53.945376 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:53.944965 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:55:53.945376 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:53.945195 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:53.945489 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:53.945398 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:55:54.943467 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:54.942895 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:54.943467 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:54.943026 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:55:55.583620 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:55.583586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:55.584088 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:55.583661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:55.584088 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.583787 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:55.584088 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.583832 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret podName:dabca611-e058-4d83-9c92-020a594e5d88 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:03.583818563 +0000 UTC m=+18.080251421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret") pod "global-pull-secret-syncer-7zvwb" (UID: "dabca611-e058-4d83-9c92-020a594e5d88") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:55:55.584263 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.584183 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:55.584263 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.584231 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:03.584215649 +0000 UTC m=+18.080648512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:55:55.684215 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:55.684177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:55.684395 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.684336 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:55:55.684395 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.684363 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:55:55.684395 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.684376 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2qrtw for pod openshift-network-diagnostics/network-check-target-p7rg7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:55.684566 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.684430 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw podName:4f32dadb-dfb4-47ae-9d29-03999a2709d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:03.684411918 +0000 UTC m=+18.180844782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qrtw" (UniqueName: "kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw") pod "network-check-target-p7rg7" (UID: "4f32dadb-dfb4-47ae-9d29-03999a2709d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:55:55.943734 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:55.943202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:55.943734 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.943312 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:55:55.944085 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:55.944058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:55.944200 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:55.944183 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:55:56.942827 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:56.942307 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:56.942827 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:56.942439 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:55:57.942822 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:57.942788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:57.943309 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:57.942937 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:55:57.943309 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:57.942788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:57.943443 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:57.943366 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:55:58.942891 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:58.942859 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:55:58.943345 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:58.942993 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:55:59.945068 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:59.945036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:55:59.945068 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:55:59.945070 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:55:59.945454 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:59.945176 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:55:59.945454 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:55:59.945278 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:00.943029 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:00.942984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:00.943227 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:00.943107 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:01.942530 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:01.942478 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:01.942991 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:01.942542 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:01.942991 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:01.942689 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:01.943155 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:01.943131 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:02.942995 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:02.942959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:02.943515 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:02.943096 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:03.648135 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:03.648093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:03.648300 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:03.648160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:03.648300 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.648244 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:56:03.648300 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.648248 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:56:03.648300 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.648298 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret podName:dabca611-e058-4d83-9c92-020a594e5d88 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:19.648284205 +0000 UTC m=+34.144717062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret") pod "global-pull-secret-syncer-7zvwb" (UID: "dabca611-e058-4d83-9c92-020a594e5d88") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:56:03.648433 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.648312 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:19.648305391 +0000 UTC m=+34.144738249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:56:03.749154 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:03.749112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:03.749331 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.749299 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:56:03.749331 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.749320 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:56:03.749331 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.749333 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2qrtw for pod openshift-network-diagnostics/network-check-target-p7rg7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:56:03.749470 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.749401 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw podName:4f32dadb-dfb4-47ae-9d29-03999a2709d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:19.749381373 +0000 UTC m=+34.245814239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qrtw" (UniqueName: "kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw") pod "network-check-target-p7rg7" (UID: "4f32dadb-dfb4-47ae-9d29-03999a2709d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:56:03.942235 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:03.942141 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:03.942235 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:03.942175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:03.942427 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.942266 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:03.942427 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:03.942392 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:04.943152 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:04.943118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:04.943566 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:04.943225 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:05.943607 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:05.943392 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:05.944086 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:05.943468 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:05.944086 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:05.943698 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:05.944086 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:05.943814 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:06.942650 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:06.942616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:06.942838 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:06.942746 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:07.942723 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:07.942676 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:07.943296 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:07.942839 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:07.943296 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:07.942884 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:07.943296 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:07.942981 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:08.942378 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:08.942081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:08.942378 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:08.942352 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:09.121455 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.121420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lnhpt" event={"ID":"88ebfcba-80ce-4fb6-83b5-a4ee524cbef0","Type":"ContainerStarted","Data":"fdc46e0c7c59a9670ffd9c05522432c9a909fc735d580f37827d9e45af958d0c"} Jul 10 22:56:09.126117 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.126083 2578 generic.go:356] "Generic (PLEG): container finished" podID="a901a703-a86b-44f3-97a6-2081fda5042d" containerID="dcc4eea8b64080dbfcaf84161a3df05765b96203691d7e2f94952441d1bbec2c" exitCode=0 Jul 10 22:56:09.126246 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.126158 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" event={"ID":"a901a703-a86b-44f3-97a6-2081fda5042d","Type":"ContainerDied","Data":"dcc4eea8b64080dbfcaf84161a3df05765b96203691d7e2f94952441d1bbec2c"} Jul 10 22:56:09.127734 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.127631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s56qh" event={"ID":"54b04330-58f8-4df4-9ba2-79950539353f","Type":"ContainerStarted","Data":"d307198c95d3be3e5effde5454a271aed883c9a466ca6003d8f561dc1cc8653b"} Jul 10 22:56:09.129384 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.129361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jg9xc" event={"ID":"76386443-600f-4203-9262-9d5b3465cb66","Type":"ContainerStarted","Data":"d5083a31934fa92e9dbe235a5b79e8e08303436f0525716f91eda7129558f100"} Jul 10 22:56:09.130790 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.130769 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" event={"ID":"a483e306-3800-43c2-9802-6469e1f01881","Type":"ContainerStarted","Data":"82b986998631dd0025ddc63847b395e0e91fbd9734725125c03ff9403b893353"} Jul 10 22:56:09.132192 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.132168 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" event={"ID":"b5ce1504-fb11-433e-b899-c6227ba9ea44","Type":"ContainerStarted","Data":"07b5aa264c03ec1cf48bb8b61095b1255cc3918d74990196a6fe5ad561e8e1ff"} Jul 10 22:56:09.133482 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.133461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mh4v2" event={"ID":"137634da-e1b2-4e22-8edd-4c2c7589d04e","Type":"ContainerStarted","Data":"e4563e5b8d0462a11ce8994888b5a38e416e1609ce14922330cb5c693eb3fe26"} Jul 10 22:56:09.135901 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.135884 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 22:56:09.136196 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.136173 2578 generic.go:356] "Generic (PLEG): container finished" podID="6ead4faf-1e4b-4c26-bc9c-62b3067b0352" containerID="3861fa0166b9f9bec3131b391a55cf9a4a5378e413c9c820c8710429b3fffb5f" exitCode=1 Jul 10 22:56:09.136287 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.136203 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerStarted","Data":"69a6d717e5433627819c204d35db178c734c7e11d0360c24cbcca0b2274896e0"} Jul 10 22:56:09.136287 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.136253 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerStarted","Data":"39bfb732ceedecd965f8e3ca29c202c80b1554af4e0028b9b13f024a85d960bf"} Jul 10 22:56:09.136287 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.136282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerStarted","Data":"e0006d3c18a5cc78bcb6bba81e46fa9b86e29da315b3b8de5716c5545d9595ef"} Jul 10 22:56:09.136381 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.136309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerStarted","Data":"4071c789a44e5e5c142da87bd0e5ba8487f4a747ac8d232918c4acef93c2ec17"} Jul 10 22:56:09.136381 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.136336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerDied","Data":"3861fa0166b9f9bec3131b391a55cf9a4a5378e413c9c820c8710429b3fffb5f"} Jul 10 22:56:09.136381 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.136364 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerStarted","Data":"35d850dd0e1f3c5aeb71cbbd82580553cdc0595b33b818a554e691cca87ade4f"} Jul 10 22:56:09.137893 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.137858 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-146.ec2.internal" podStartSLOduration=22.137844938 podStartE2EDuration="22.137844938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:55:51.087180443 +0000 UTC m=+5.583613324" watchObservedRunningTime="2026-07-10 22:56:09.137844938 +0000 UTC m=+23.634277839" Jul 10 22:56:09.137997 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.137980 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lnhpt" podStartSLOduration=4.147143252 podStartE2EDuration="23.137974747s" totalImagesPullingTime="18.990831495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:09.137560767 +0000 UTC m=+23.633993650" watchObservedRunningTime="2026-07-10 22:56:09.137974747 +0000 UTC m=+23.634407627" Jul 10 22:56:09.153055 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.153008 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mh4v2" podStartSLOduration=4.220225158 podStartE2EDuration="23.152995335s" totalImagesPullingTime="18.932770177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:09.152479628 +0000 UTC m=+23.648912507" watchObservedRunningTime="2026-07-10 22:56:09.152995335 +0000 UTC m=+23.649428214" Jul 10 22:56:09.172654 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.172599 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n6dbg" podStartSLOduration=4.208576847 podStartE2EDuration="23.172581813s" totalImagesPullingTime="18.964004966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:09.172203206 +0000 UTC m=+23.668636085" watchObservedRunningTime="2026-07-10 22:56:09.172581813 +0000 UTC m=+23.669014693" Jul 10 22:56:09.187660 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.187609 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s56qh" podStartSLOduration=4.263495456 podStartE2EDuration="23.187594675s" totalImagesPullingTime="18.924099219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:09.187095454 +0000 UTC m=+23.683528334" watchObservedRunningTime="2026-07-10 22:56:09.187594675 +0000 UTC m=+23.684027555" Jul 10 22:56:09.202360 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.202314 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jg9xc" podStartSLOduration=4.24032885 podStartE2EDuration="23.202298737s" totalImagesPullingTime="18.961969887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:09.20211108 +0000 UTC m=+23.698543951" watchObservedRunningTime="2026-07-10 22:56:09.202298737 +0000 UTC m=+23.698731618" Jul 10 22:56:09.561179 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.560962 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 22:56:09.887187 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.887087 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T22:56:09.561171836Z","UUID":"b0ce54c9-14fb-4ccb-9505-34bb0a812b8a","Handler":null,"Name":"","Endpoint":""} Jul 10 22:56:09.889121 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.889089 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 22:56:09.889121 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.889119 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 22:56:09.942167 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.942137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:09.942357 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:09.942142 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:09.942420 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:09.942283 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:09.942458 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:09.942417 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:10.140676 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:10.140582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5k569" event={"ID":"3b57058c-d6c3-42d8-a160-876e091c5b4c","Type":"ContainerStarted","Data":"2290c5b3484a60a311228b2771d8efc46e80844e635fee8ea389f68e1180ab09"} Jul 10 22:56:10.142802 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:10.142761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" event={"ID":"b5ce1504-fb11-433e-b899-c6227ba9ea44","Type":"ContainerStarted","Data":"466d78be3d50e339bf7e0050980f31b23d26c29e5fa382a600099106d2d85e27"} Jul 10 22:56:10.154907 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:10.154845 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5k569" podStartSLOduration=5.230554366 podStartE2EDuration="24.154829636s" totalImagesPullingTime="18.92427527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:10.154781439 +0000 UTC m=+24.651214320" watchObservedRunningTime="2026-07-10 22:56:10.154829636 +0000 UTC m=+24.651262557" Jul 10 22:56:10.833672 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:10.833629 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:56:10.834221 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:10.834205 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:56:10.943119 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:10.943043 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:10.943269 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:10.943152 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:11.147941 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:11.147903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" event={"ID":"b5ce1504-fb11-433e-b899-c6227ba9ea44","Type":"ContainerStarted","Data":"c60854bb31879a02d690ace0426ea86de5512a217f7ccb9a18ead5bcc35fcf81"} Jul 10 22:56:11.148522 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:11.148401 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:56:11.148675 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:11.148660 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mh4v2" Jul 10 22:56:11.163886 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:11.163844 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q47vd" podStartSLOduration=3.9497342079999997 podStartE2EDuration="25.163824596s" totalImagesPullingTime="21.214090388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:11.162784677 +0000 UTC m=+25.659217558" watchObservedRunningTime="2026-07-10 22:56:11.163824596 +0000 UTC m=+25.660257477" Jul 10 22:56:11.942891 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:11.942856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:11.943090 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:11.942856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:11.943090 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:11.943009 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:11.943192 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:11.943091 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:12.153842 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:12.153813 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 22:56:12.154366 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:12.154231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerStarted","Data":"7b44ba9610729aebe68003d7e7cf941c6be7a187c905b477116d84f357d28098"} Jul 10 22:56:12.942216 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:12.942171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:12.942385 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:12.942316 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:13.942722 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:13.942516 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:13.943282 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:13.942531 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:13.943282 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:13.942801 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:13.943282 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:13.942880 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:14.161482 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:14.161451 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 22:56:14.161877 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:14.161852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerStarted","Data":"aa1a94bdab390deee565c102cdd9a063875de92b8e6a1062d82d1b786a21a455"} Jul 10 22:56:14.162222 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:14.162191 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:56:14.162320 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:14.162308 2578 scope.go:117] "RemoveContainer" containerID="3861fa0166b9f9bec3131b391a55cf9a4a5378e413c9c820c8710429b3fffb5f" Jul 10 22:56:14.164295 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:14.164270 2578 generic.go:356] "Generic (PLEG): container finished" podID="a901a703-a86b-44f3-97a6-2081fda5042d" containerID="44a637efc8769ed9701f99f2d3f8750c1ed7c8a13b708054f63b9c9aec571076" exitCode=0 Jul 10 22:56:14.164402 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:14.164312 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" event={"ID":"a901a703-a86b-44f3-97a6-2081fda5042d","Type":"ContainerDied","Data":"44a637efc8769ed9701f99f2d3f8750c1ed7c8a13b708054f63b9c9aec571076"} Jul 10 22:56:14.180967 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:14.180942 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:56:14.942665 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:14.942630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:14.942866 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:14.942789 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:15.173791 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.173766 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 22:56:15.174149 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.174128 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" event={"ID":"6ead4faf-1e4b-4c26-bc9c-62b3067b0352","Type":"ContainerStarted","Data":"65843db24f205a32f4a23a4d97f0494158024a4e1c58e6ee378304ab6011364d"} Jul 10 22:56:15.174436 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.174412 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:56:15.174506 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.174494 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:56:15.190850 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.190819 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:56:15.199083 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.198994 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" podStartSLOduration=10.029773942 podStartE2EDuration="29.198978198s" totalImagesPullingTime="19.169204256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:15.197580472 +0000 UTC m=+29.694013351" watchObservedRunningTime="2026-07-10 22:56:15.198978198 +0000 UTC m=+29.695411105" Jul 10 22:56:15.383572 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.383404 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7zvwb"] Jul 10 22:56:15.383740 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.383667 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:15.383817 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:15.383795 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:15.387173 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.387144 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p7rg7"] Jul 10 22:56:15.387305 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.387255 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:15.387385 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:15.387363 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:15.387849 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.387827 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zktgk"] Jul 10 22:56:15.387974 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:15.387944 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:15.388071 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:15.388052 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:16.178112 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:16.178076 2578 generic.go:356] "Generic (PLEG): container finished" podID="a901a703-a86b-44f3-97a6-2081fda5042d" containerID="2651c2a54e0a360abc5b1989749f0a934e3ee1b52760d86ed22d07e78f32874a" exitCode=0 Jul 10 22:56:16.178735 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:16.178170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" event={"ID":"a901a703-a86b-44f3-97a6-2081fda5042d","Type":"ContainerDied","Data":"2651c2a54e0a360abc5b1989749f0a934e3ee1b52760d86ed22d07e78f32874a"} Jul 10 22:56:16.943143 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:16.943102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:16.943309 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:16.943151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:16.943309 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:16.943109 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:16.943309 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:16.943232 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:16.943309 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:16.943281 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:16.943447 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:16.943360 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:18.184985 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:18.184942 2578 generic.go:356] "Generic (PLEG): container finished" podID="a901a703-a86b-44f3-97a6-2081fda5042d" containerID="249869cfafa8771708870676b63b30cf2f563103d0624bdbcea4d02ac46e8e82" exitCode=0 Jul 10 22:56:18.185689 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:18.184992 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" event={"ID":"a901a703-a86b-44f3-97a6-2081fda5042d","Type":"ContainerDied","Data":"249869cfafa8771708870676b63b30cf2f563103d0624bdbcea4d02ac46e8e82"} Jul 10 22:56:18.943004 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:18.942975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:18.943201 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:18.943078 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:18.943201 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:18.943176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:18.943320 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:18.943186 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:18.943320 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:18.943286 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:18.943412 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:18.943376 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:19.663293 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:19.663257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:19.663293 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:19.663308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:19.663918 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:19.663419 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:56:19.663918 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:19.663419 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:56:19.663918 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:19.663487 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret podName:dabca611-e058-4d83-9c92-020a594e5d88 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:51.66346785 +0000 UTC m=+66.159900711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret") pod "global-pull-secret-syncer-7zvwb" (UID: "dabca611-e058-4d83-9c92-020a594e5d88") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:56:19.663918 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:19.663505 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:51.663497036 +0000 UTC m=+66.159929895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:56:19.763906 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:19.763865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:19.764085 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:19.764056 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:56:19.764085 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:19.764078 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:56:19.764187 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:19.764088 2578 projected.go:196] Error preparing data for projected volume kube-api-access-2qrtw for pod openshift-network-diagnostics/network-check-target-p7rg7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:56:19.764187 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:19.764135 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw podName:4f32dadb-dfb4-47ae-9d29-03999a2709d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:51.764121951 +0000 UTC m=+66.260554809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qrtw" (UniqueName: "kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw") pod "network-check-target-p7rg7" (UID: "4f32dadb-dfb4-47ae-9d29-03999a2709d1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:56:20.943333 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:20.943110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:20.943833 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:20.943113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:20.943833 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:20.943428 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7rg7" podUID="4f32dadb-dfb4-47ae-9d29-03999a2709d1" Jul 10 22:56:20.943833 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:20.943110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:20.943833 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:20.943482 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7zvwb" podUID="dabca611-e058-4d83-9c92-020a594e5d88" Jul 10 22:56:20.943833 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:20.943621 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:56:21.832225 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.832193 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-146.ec2.internal" event="NodeReady" Jul 10 22:56:21.832401 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.832351 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 22:56:21.874246 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.874123 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pjgcr"] Jul 10 22:56:21.876673 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.876651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:21.879165 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.879137 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 22:56:21.879165 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.879148 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 22:56:21.879337 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.879146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5n6l\"" Jul 10 22:56:21.881905 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.881878 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7fbsp"] Jul 10 22:56:21.883408 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.883391 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7fbsp" Jul 10 22:56:21.885328 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.885306 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pjgcr"] Jul 10 22:56:21.886878 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.886687 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 22:56:21.887255 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.887231 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 22:56:21.887644 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.887626 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 22:56:21.887931 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.887913 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ld9cp\"" Jul 10 22:56:21.894356 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.894049 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7fbsp"] Jul 10 22:56:21.980118 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.980078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23e16f1d-18fe-4093-a939-acb9948155f3-tmp-dir\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:21.980574 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.980138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:21.980574 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.980178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23e16f1d-18fe-4093-a939-acb9948155f3-config-volume\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:21.980574 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.980201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4jw\" (UniqueName: \"kubernetes.io/projected/13c5e442-70d0-45ff-b81a-53dd2bc14b98-kube-api-access-8g4jw\") pod \"ingress-canary-7fbsp\" (UID: \"13c5e442-70d0-45ff-b81a-53dd2bc14b98\") " pod="openshift-ingress-canary/ingress-canary-7fbsp" Jul 10 22:56:21.980574 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.980251 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whp4x\" (UniqueName: \"kubernetes.io/projected/23e16f1d-18fe-4093-a939-acb9948155f3-kube-api-access-whp4x\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:21.980574 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:21.980277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13c5e442-70d0-45ff-b81a-53dd2bc14b98-cert\") pod \"ingress-canary-7fbsp\" (UID: \"13c5e442-70d0-45ff-b81a-53dd2bc14b98\") " pod="openshift-ingress-canary/ingress-canary-7fbsp" Jul 10 22:56:22.081440 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.081401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23e16f1d-18fe-4093-a939-acb9948155f3-tmp-dir\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:22.081629 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.081455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:22.081629 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.081490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23e16f1d-18fe-4093-a939-acb9948155f3-config-volume\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:22.081629 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.081514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4jw\" (UniqueName: \"kubernetes.io/projected/13c5e442-70d0-45ff-b81a-53dd2bc14b98-kube-api-access-8g4jw\") pod \"ingress-canary-7fbsp\" (UID: \"13c5e442-70d0-45ff-b81a-53dd2bc14b98\") " pod="openshift-ingress-canary/ingress-canary-7fbsp" Jul 10 22:56:22.081629 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.081556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whp4x\" (UniqueName: \"kubernetes.io/projected/23e16f1d-18fe-4093-a939-acb9948155f3-kube-api-access-whp4x\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:22.081629 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.081579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13c5e442-70d0-45ff-b81a-53dd2bc14b98-cert\") pod \"ingress-canary-7fbsp\" (UID: \"13c5e442-70d0-45ff-b81a-53dd2bc14b98\") " pod="openshift-ingress-canary/ingress-canary-7fbsp" Jul 10 22:56:22.081932 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:22.081640 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:56:22.081932 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:22.081735 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls podName:23e16f1d-18fe-4093-a939-acb9948155f3 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:22.581696631 +0000 UTC m=+37.078129490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls") pod "dns-default-pjgcr" (UID: "23e16f1d-18fe-4093-a939-acb9948155f3") : secret "dns-default-metrics-tls" not found Jul 10 22:56:22.081932 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.081843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23e16f1d-18fe-4093-a939-acb9948155f3-tmp-dir\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:22.082215 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.082189 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23e16f1d-18fe-4093-a939-acb9948155f3-config-volume\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:22.086530 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.086500 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13c5e442-70d0-45ff-b81a-53dd2bc14b98-cert\") pod \"ingress-canary-7fbsp\" (UID: \"13c5e442-70d0-45ff-b81a-53dd2bc14b98\") " pod="openshift-ingress-canary/ingress-canary-7fbsp" Jul 10 22:56:22.094699 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.094657 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whp4x\" (UniqueName: \"kubernetes.io/projected/23e16f1d-18fe-4093-a939-acb9948155f3-kube-api-access-whp4x\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:22.094975 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.094949 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4jw\" (UniqueName: \"kubernetes.io/projected/13c5e442-70d0-45ff-b81a-53dd2bc14b98-kube-api-access-8g4jw\") pod \"ingress-canary-7fbsp\" (UID: \"13c5e442-70d0-45ff-b81a-53dd2bc14b98\") " pod="openshift-ingress-canary/ingress-canary-7fbsp" Jul 10 22:56:22.200432 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.200343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7fbsp" Jul 10 22:56:22.474546 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.474512 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7fbsp"] Jul 10 22:56:22.479953 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:56:22.479923 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c5e442_70d0_45ff_b81a_53dd2bc14b98.slice/crio-031343f08a7e8c7f56a191617bda142d5eb40b17ffc77d7e70d9a3c63c0e33f6 WatchSource:0}: Error finding container 031343f08a7e8c7f56a191617bda142d5eb40b17ffc77d7e70d9a3c63c0e33f6: Status 404 returned error can't find the container with id 031343f08a7e8c7f56a191617bda142d5eb40b17ffc77d7e70d9a3c63c0e33f6 Jul 10 22:56:22.587088 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.587055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:22.587251 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:22.587228 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:56:22.587328 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:22.587315 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls podName:23e16f1d-18fe-4093-a939-acb9948155f3 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:23.587293514 +0000 UTC m=+38.083726385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls") pod "dns-default-pjgcr" (UID: "23e16f1d-18fe-4093-a939-acb9948155f3") : secret "dns-default-metrics-tls" not found Jul 10 22:56:22.943013 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.942975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:22.943181 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.943024 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:22.943181 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.942975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:22.945497 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.945474 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 22:56:22.945637 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.945549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 22:56:22.945737 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.945699 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jr855\"" Jul 10 22:56:22.946620 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.946277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 22:56:22.946620 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.946385 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cgdm\"" Jul 10 22:56:22.946620 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:22.946472 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 22:56:23.202280 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:23.201996 2578 generic.go:356] "Generic (PLEG): container finished" podID="a901a703-a86b-44f3-97a6-2081fda5042d" containerID="6c243274b34e1616a51a15d2af5c924babe8ead318ba6d8d823c5f499ab1509b" exitCode=0 Jul 10 22:56:23.202636 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:23.202069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" event={"ID":"a901a703-a86b-44f3-97a6-2081fda5042d","Type":"ContainerDied","Data":"6c243274b34e1616a51a15d2af5c924babe8ead318ba6d8d823c5f499ab1509b"} Jul 10 22:56:23.203457 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:23.203435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7fbsp" event={"ID":"13c5e442-70d0-45ff-b81a-53dd2bc14b98","Type":"ContainerStarted","Data":"031343f08a7e8c7f56a191617bda142d5eb40b17ffc77d7e70d9a3c63c0e33f6"} Jul 10 22:56:23.593597 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:23.593556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:23.593829 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:23.593699 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:56:23.593829 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:23.593792 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls podName:23e16f1d-18fe-4093-a939-acb9948155f3 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:25.593771551 +0000 UTC m=+40.090204425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls") pod "dns-default-pjgcr" (UID: "23e16f1d-18fe-4093-a939-acb9948155f3") : secret "dns-default-metrics-tls" not found Jul 10 22:56:24.209792 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:24.209757 2578 generic.go:356] "Generic (PLEG): container finished" podID="a901a703-a86b-44f3-97a6-2081fda5042d" containerID="25163d7bfb52da208553fcebf65c443bd2a60a95c59318a8ce8d4be4aee83932" exitCode=0 Jul 10 22:56:24.210307 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:24.209822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" event={"ID":"a901a703-a86b-44f3-97a6-2081fda5042d","Type":"ContainerDied","Data":"25163d7bfb52da208553fcebf65c443bd2a60a95c59318a8ce8d4be4aee83932"} Jul 10 22:56:25.216144 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:25.216045 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" event={"ID":"a901a703-a86b-44f3-97a6-2081fda5042d","Type":"ContainerStarted","Data":"ac09fa4fbfc1514e2c8f3d42eac69c5e54445a1407f48b20e0fa6c2c0b622161"} Jul 10 22:56:25.217484 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:25.217457 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7fbsp" event={"ID":"13c5e442-70d0-45ff-b81a-53dd2bc14b98","Type":"ContainerStarted","Data":"43617f7742a9cfc00838d2e44e0648446ed41a890367071119e8ec0858394ad4"} Jul 10 22:56:25.236937 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:25.236886 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tw8tv" podStartSLOduration=9.547190844 podStartE2EDuration="39.236870321s" totalImagesPullingTime="29.689679477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:25.235667016 +0000 UTC m=+39.732099897" watchObservedRunningTime="2026-07-10 22:56:25.236870321 +0000 UTC m=+39.733303200" Jul 10 22:56:25.249231 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:25.249175 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7fbsp" podStartSLOduration=1.853497317 podStartE2EDuration="4.249156108s" totalImagesPullingTime="2.395658791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:25.24891798 +0000 UTC m=+39.745350859" watchObservedRunningTime="2026-07-10 22:56:25.249156108 +0000 UTC m=+39.745588991" Jul 10 22:56:25.609109 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:25.609066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:25.609286 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:25.609224 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:56:25.609337 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:25.609308 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls podName:23e16f1d-18fe-4093-a939-acb9948155f3 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:29.609292875 +0000 UTC m=+44.105725734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls") pod "dns-default-pjgcr" (UID: "23e16f1d-18fe-4093-a939-acb9948155f3") : secret "dns-default-metrics-tls" not found Jul 10 22:56:29.639094 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:29.639045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:29.639536 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:29.639164 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:56:29.639536 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:29.639215 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls podName:23e16f1d-18fe-4093-a939-acb9948155f3 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:37.639202709 +0000 UTC m=+52.135635567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls") pod "dns-default-pjgcr" (UID: "23e16f1d-18fe-4093-a939-acb9948155f3") : secret "dns-default-metrics-tls" not found Jul 10 22:56:37.701151 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:37.701108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:37.701652 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:37.701240 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:56:37.701652 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:37.701293 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls podName:23e16f1d-18fe-4093-a939-acb9948155f3 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:53.701279315 +0000 UTC m=+68.197712172 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls") pod "dns-default-pjgcr" (UID: "23e16f1d-18fe-4093-a939-acb9948155f3") : secret "dns-default-metrics-tls" not found Jul 10 22:56:47.202202 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:47.202168 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8ldq" Jul 10 22:56:51.693583 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.693540 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:56:51.694008 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.693615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:51.695912 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.695887 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 22:56:51.696035 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.696018 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 22:56:51.704681 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:51.704656 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 22:56:51.704778 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:51.704747 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 22:57:55.704731182 +0000 UTC m=+130.201164039 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : secret "metrics-daemon-secret" not found Jul 10 22:56:51.708155 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.708129 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dabca611-e058-4d83-9c92-020a594e5d88-original-pull-secret\") pod \"global-pull-secret-syncer-7zvwb\" (UID: \"dabca611-e058-4d83-9c92-020a594e5d88\") " pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:51.759534 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.759482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7zvwb" Jul 10 22:56:51.794772 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.794694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:51.797467 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.797437 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 22:56:51.807839 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.807814 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 22:56:51.818161 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.818129 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qrtw\" (UniqueName: \"kubernetes.io/projected/4f32dadb-dfb4-47ae-9d29-03999a2709d1-kube-api-access-2qrtw\") pod \"network-check-target-p7rg7\" (UID: \"4f32dadb-dfb4-47ae-9d29-03999a2709d1\") " pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:51.905739 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:51.905689 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7zvwb"] Jul 10 22:56:51.909258 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:56:51.909232 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddabca611_e058_4d83_9c92_020a594e5d88.slice/crio-f0bf0b3c06ca2a544eec1bb0782afc6ca601232885c8cd40115d136ba3658a12 WatchSource:0}: Error finding container f0bf0b3c06ca2a544eec1bb0782afc6ca601232885c8cd40115d136ba3658a12: Status 404 returned error can't find the container with id f0bf0b3c06ca2a544eec1bb0782afc6ca601232885c8cd40115d136ba3658a12 Jul 10 22:56:52.065925 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:52.065889 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cgdm\"" Jul 10 22:56:52.073804 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:52.073767 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:52.197176 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:52.197146 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p7rg7"] Jul 10 22:56:52.200782 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:56:52.200743 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f32dadb_dfb4_47ae_9d29_03999a2709d1.slice/crio-443baafc25805e20d193dc0a96b5c68e99dd014da822307bed9b990ed5cf80e5 WatchSource:0}: Error finding container 443baafc25805e20d193dc0a96b5c68e99dd014da822307bed9b990ed5cf80e5: Status 404 returned error can't find the container with id 443baafc25805e20d193dc0a96b5c68e99dd014da822307bed9b990ed5cf80e5 Jul 10 22:56:52.285026 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:52.284990 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p7rg7" event={"ID":"4f32dadb-dfb4-47ae-9d29-03999a2709d1","Type":"ContainerStarted","Data":"443baafc25805e20d193dc0a96b5c68e99dd014da822307bed9b990ed5cf80e5"} Jul 10 22:56:52.286051 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:52.286030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7zvwb" event={"ID":"dabca611-e058-4d83-9c92-020a594e5d88","Type":"ContainerStarted","Data":"f0bf0b3c06ca2a544eec1bb0782afc6ca601232885c8cd40115d136ba3658a12"} Jul 10 22:56:53.710401 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:53.710356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:56:53.710876 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:53.710485 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:56:53.710876 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:56:53.710557 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls podName:23e16f1d-18fe-4093-a939-acb9948155f3 nodeName:}" failed. No retries permitted until 2026-07-10 22:57:25.710535116 +0000 UTC m=+100.206967974 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls") pod "dns-default-pjgcr" (UID: "23e16f1d-18fe-4093-a939-acb9948155f3") : secret "dns-default-metrics-tls" not found Jul 10 22:56:57.301852 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:57.301808 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p7rg7" event={"ID":"4f32dadb-dfb4-47ae-9d29-03999a2709d1","Type":"ContainerStarted","Data":"5e95b32da4493efc1ba55788ead29883034003f66338f2567052bc2aa332583d"} Jul 10 22:56:57.302302 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:57.301925 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:56:57.303350 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:57.303326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7zvwb" event={"ID":"dabca611-e058-4d83-9c92-020a594e5d88","Type":"ContainerStarted","Data":"b7e504c5e36ff926ce3b7d734670767bde91a6ff63a496a3fdcc08d2b350708f"} Jul 10 22:56:57.318679 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:57.318633 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p7rg7" podStartSLOduration=66.821239646 podStartE2EDuration="1m11.318617766s" totalImagesPullingTime="4.49737812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:57.318081951 +0000 UTC m=+71.814514832" watchObservedRunningTime="2026-07-10 22:56:57.318617766 +0000 UTC m=+71.815050624" Jul 10 22:56:57.331924 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:56:57.331871 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7zvwb" podStartSLOduration=66.539958534 podStartE2EDuration="1m11.331853636s" totalImagesPullingTime="4.791895102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:57.330975933 +0000 UTC m=+71.827408812" watchObservedRunningTime="2026-07-10 22:56:57.331853636 +0000 UTC m=+71.828286881" Jul 10 22:57:14.972638 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:14.972495 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z"] Jul 10 22:57:14.976912 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:14.976887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" Jul 10 22:57:14.980002 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:14.979954 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 22:57:14.980002 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:14.979954 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 10 22:57:14.980201 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:14.980003 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 22:57:14.980201 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:14.979956 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vwz49\"" Jul 10 22:57:14.980201 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:14.979954 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 22:57:14.984502 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:14.984476 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z"] Jul 10 22:57:15.064070 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:15.064029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l84r\" (UniqueName: \"kubernetes.io/projected/55ab3b71-bd76-44b5-8c7f-49fa22a19d98-kube-api-access-7l84r\") pod \"managed-serviceaccount-addon-agent-55794f6784-ktp5z\" (UID: \"55ab3b71-bd76-44b5-8c7f-49fa22a19d98\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" Jul 10 22:57:15.064245 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:15.064129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55ab3b71-bd76-44b5-8c7f-49fa22a19d98-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55794f6784-ktp5z\" (UID: \"55ab3b71-bd76-44b5-8c7f-49fa22a19d98\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" Jul 10 22:57:15.164431 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:15.164389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55ab3b71-bd76-44b5-8c7f-49fa22a19d98-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55794f6784-ktp5z\" (UID: \"55ab3b71-bd76-44b5-8c7f-49fa22a19d98\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" Jul 10 22:57:15.164625 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:15.164442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l84r\" (UniqueName: \"kubernetes.io/projected/55ab3b71-bd76-44b5-8c7f-49fa22a19d98-kube-api-access-7l84r\") pod \"managed-serviceaccount-addon-agent-55794f6784-ktp5z\" (UID: \"55ab3b71-bd76-44b5-8c7f-49fa22a19d98\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" Jul 10 22:57:15.167048 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:15.167022 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55ab3b71-bd76-44b5-8c7f-49fa22a19d98-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55794f6784-ktp5z\" (UID: \"55ab3b71-bd76-44b5-8c7f-49fa22a19d98\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" Jul 10 22:57:15.172734 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:15.172691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l84r\" (UniqueName: \"kubernetes.io/projected/55ab3b71-bd76-44b5-8c7f-49fa22a19d98-kube-api-access-7l84r\") pod \"managed-serviceaccount-addon-agent-55794f6784-ktp5z\" (UID: \"55ab3b71-bd76-44b5-8c7f-49fa22a19d98\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" Jul 10 22:57:15.299160 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:15.299126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" Jul 10 22:57:15.431629 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:15.431587 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z"] Jul 10 22:57:15.435568 ip-10-0-135-146 kubenswrapper[2578]: W0710 22:57:15.435534 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55ab3b71_bd76_44b5_8c7f_49fa22a19d98.slice/crio-bbd2fc03da3b3f9445132b2cf2ba00eb09c5768f31347ed16e7acd724c446b72 WatchSource:0}: Error finding container bbd2fc03da3b3f9445132b2cf2ba00eb09c5768f31347ed16e7acd724c446b72: Status 404 returned error can't find the container with id bbd2fc03da3b3f9445132b2cf2ba00eb09c5768f31347ed16e7acd724c446b72 Jul 10 22:57:16.352288 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:16.352254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" event={"ID":"55ab3b71-bd76-44b5-8c7f-49fa22a19d98","Type":"ContainerStarted","Data":"bbd2fc03da3b3f9445132b2cf2ba00eb09c5768f31347ed16e7acd724c446b72"} Jul 10 22:57:18.358972 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:18.358926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" event={"ID":"55ab3b71-bd76-44b5-8c7f-49fa22a19d98","Type":"ContainerStarted","Data":"7d1ab9933a41c7f5889c84025285e93b3db777d0a429af5152a93a07077eb620"} Jul 10 22:57:18.373445 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:18.373390 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" podStartSLOduration=1.640393287 podStartE2EDuration="4.373375009s" totalImagesPullingTime="2.732981722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:57:18.372867601 +0000 UTC m=+92.869300482" watchObservedRunningTime="2026-07-10 22:57:18.373375009 +0000 UTC m=+92.869807888" Jul 10 22:57:25.745333 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:25.745271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:57:25.745826 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:57:25.745435 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:57:25.745826 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:57:25.745508 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls podName:23e16f1d-18fe-4093-a939-acb9948155f3 nodeName:}" failed. No retries permitted until 2026-07-10 22:58:29.745491824 +0000 UTC m=+164.241924684 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls") pod "dns-default-pjgcr" (UID: "23e16f1d-18fe-4093-a939-acb9948155f3") : secret "dns-default-metrics-tls" not found Jul 10 22:57:28.308497 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:28.308465 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p7rg7" Jul 10 22:57:55.751330 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:57:55.751274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:57:55.751978 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:57:55.751441 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 22:57:55.751978 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:57:55.751527 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 22:59:57.751505274 +0000 UTC m=+252.247938144 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : secret "metrics-daemon-secret" not found Jul 10 22:58:24.890922 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:58:24.890874 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pjgcr" podUID="23e16f1d-18fe-4093-a939-acb9948155f3" Jul 10 22:58:25.516659 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:58:25.516625 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjgcr" Jul 10 22:58:25.953088 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:58:25.953046 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 22:58:29.787972 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:58:29.787921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 22:58:29.788446 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:58:29.788051 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:58:29.788446 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:58:29.788116 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls podName:23e16f1d-18fe-4093-a939-acb9948155f3 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:31.788101178 +0000 UTC m=+286.284534036 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls") pod "dns-default-pjgcr" (UID: "23e16f1d-18fe-4093-a939-acb9948155f3") : secret "dns-default-metrics-tls" not found Jul 10 22:58:39.942828 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:58:39.942740 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:59:18.648756 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:59:18.648657 2578 generic.go:356] "Generic (PLEG): container finished" podID="55ab3b71-bd76-44b5-8c7f-49fa22a19d98" containerID="7d1ab9933a41c7f5889c84025285e93b3db777d0a429af5152a93a07077eb620" exitCode=255 Jul 10 22:59:18.648756 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:59:18.648738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" event={"ID":"55ab3b71-bd76-44b5-8c7f-49fa22a19d98","Type":"ContainerDied","Data":"7d1ab9933a41c7f5889c84025285e93b3db777d0a429af5152a93a07077eb620"} Jul 10 22:59:18.654377 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:59:18.654359 2578 scope.go:117] "RemoveContainer" containerID="7d1ab9933a41c7f5889c84025285e93b3db777d0a429af5152a93a07077eb620" Jul 10 22:59:19.653133 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:59:19.653102 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55794f6784-ktp5z" event={"ID":"55ab3b71-bd76-44b5-8c7f-49fa22a19d98","Type":"ContainerStarted","Data":"79a346ced519952b0490fb4f1dcf2fa96f8d359f11b7fbc89c739f3c166df2d5"} Jul 10 22:59:57.785843 ip-10-0-135-146 kubenswrapper[2578]: I0710 22:59:57.785799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 22:59:57.786343 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:59:57.785952 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 22:59:57.786343 ip-10-0-135-146 kubenswrapper[2578]: E0710 22:59:57.786041 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs podName:3c7063b8-b242-45ff-a6b2-342d66a4cc64 nodeName:}" failed. No retries permitted until 2026-07-10 23:01:59.786025226 +0000 UTC m=+374.282458087 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs") pod "network-metrics-daemon-zktgk" (UID: "3c7063b8-b242-45ff-a6b2-342d66a4cc64") : secret "metrics-daemon-secret" not found Jul 10 23:00:07.092199 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.092094 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59b45fff4d-5hvx9"] Jul 10 23:00:07.095194 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.095170 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c4f7d955b-8bmts"] Jul 10 23:00:07.095355 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.095301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.097924 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.097887 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 23:00:07.098081 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.097920 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 23:00:07.098081 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.098071 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 23:00:07.098219 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.098117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.098292 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.098280 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t4p9b\"" Jul 10 23:00:07.098620 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.098595 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 23:00:07.098755 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.098601 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 23:00:07.098755 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.098688 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 23:00:07.100774 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.100753 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 23:00:07.101036 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.101018 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 23:00:07.101193 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.101176 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-67lgp\"" Jul 10 23:00:07.101270 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.101178 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 23:00:07.106959 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.106933 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 23:00:07.109990 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.109939 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59b45fff4d-5hvx9"] Jul 10 23:00:07.116071 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.116034 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c4f7d955b-8bmts"] Jul 10 23:00:07.182993 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.182954 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6"] Jul 10 23:00:07.185990 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.185964 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-n6ntz"] Jul 10 23:00:07.186146 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.186113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:07.188420 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.188394 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bvkpp\"" Jul 10 23:00:07.188608 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.188590 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 23:00:07.188770 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.188753 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 23:00:07.188856 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.188813 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 23:00:07.188904 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.188878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.190967 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.190934 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 10 23:00:07.191079 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.190982 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 10 23:00:07.191632 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.191581 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lp28q\"" Jul 10 23:00:07.191900 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.191876 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 10 23:00:07.191995 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.191906 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 10 23:00:07.197583 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.197557 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6"] Jul 10 23:00:07.198750 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.198701 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-n6ntz"] Jul 10 23:00:07.199671 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.199645 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 10 23:00:07.244686 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.244686 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.244906 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-installation-pull-secrets\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.244906 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-default-certificate\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.244906 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-image-registry-private-configuration\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.244906 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrm6k\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-kube-api-access-mrm6k\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.244906 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.244906 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-trusted-ca\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.245088 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-stats-auth\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.245088 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea764bf-3b2a-4e1b-b762-0337a3230fba-ca-trust-extracted\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.245088 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.244998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-bound-sa-token\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.245088 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.245017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-certificates\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.245088 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.245072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvkg9\" (UniqueName: \"kubernetes.io/projected/72b247f6-05e7-4e7c-bcdd-1651a57e9123-kube-api-access-rvkg9\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.345952 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.345865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.345952 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.345921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.345952 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.345951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-default-certificate\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.346122 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.345975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-stats-auth\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.346122 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.345998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea764bf-3b2a-4e1b-b762-0337a3230fba-ca-trust-extracted\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.346122 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.346033 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 23:00:07.346122 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.346035 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 23:00:07.346122 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-bound-sa-token\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.346122 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.346050 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4f7d955b-8bmts: secret "image-registry-tls" not found Jul 10 23:00:07.346122 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.346123 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:07.84610332 +0000 UTC m=+262.342536179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : secret "router-metrics-certs-default" not found Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-config\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvkg9\" (UniqueName: \"kubernetes.io/projected/72b247f6-05e7-4e7c-bcdd-1651a57e9123-kube-api-access-rvkg9\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.346192 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls podName:9ea764bf-3b2a-4e1b-b762-0337a3230fba nodeName:}" failed. No retries permitted until 2026-07-10 23:00:07.846174765 +0000 UTC m=+262.342607625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls") pod "image-registry-c4f7d955b-8bmts" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba") : secret "image-registry-tls" not found Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-serving-cert\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-image-registry-private-configuration\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-installation-pull-secrets\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-trusted-ca\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvrfr\" (UniqueName: \"kubernetes.io/projected/5755482d-d48c-429c-be1c-236114dadb85-kube-api-access-mvrfr\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:07.346438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea764bf-3b2a-4e1b-b762-0337a3230fba-ca-trust-extracted\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.346873 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-certificates\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.346873 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrm6k\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-kube-api-access-mrm6k\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.346873 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.346545 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:07.846528721 +0000 UTC m=+262.342961580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : configmap references non-existent config key: service-ca.crt Jul 10 23:00:07.346873 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-trusted-ca\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.346873 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.346606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj82v\" (UniqueName: \"kubernetes.io/projected/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-kube-api-access-hj82v\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.347277 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.347251 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-certificates\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.347771 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.347747 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-trusted-ca\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.348981 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.348959 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-stats-auth\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.349065 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.349023 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-default-certificate\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.349280 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.349265 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-image-registry-private-configuration\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.349328 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.349307 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-installation-pull-secrets\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.354290 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.354258 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-bound-sa-token\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.354959 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.354930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrm6k\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-kube-api-access-mrm6k\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.355138 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.355122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvkg9\" (UniqueName: \"kubernetes.io/projected/72b247f6-05e7-4e7c-bcdd-1651a57e9123-kube-api-access-rvkg9\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.447702 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.447663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-config\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.447896 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.447729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:07.447896 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.447757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-serving-cert\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.447896 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.447802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-trusted-ca\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.448062 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.447902 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 23:00:07.448062 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.447942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvrfr\" (UniqueName: \"kubernetes.io/projected/5755482d-d48c-429c-be1c-236114dadb85-kube-api-access-mvrfr\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:07.448062 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.447978 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls podName:5755482d-d48c-429c-be1c-236114dadb85 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:07.94795879 +0000 UTC m=+262.444391655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls") pod "cluster-samples-operator-65db858894-d6kd6" (UID: "5755482d-d48c-429c-be1c-236114dadb85") : secret "samples-operator-tls" not found Jul 10 23:00:07.448062 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.448048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj82v\" (UniqueName: \"kubernetes.io/projected/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-kube-api-access-hj82v\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.448539 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.448513 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-config\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.448783 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.448767 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-trusted-ca\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.450399 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.450379 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-serving-cert\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.456366 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.456336 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvrfr\" (UniqueName: \"kubernetes.io/projected/5755482d-d48c-429c-be1c-236114dadb85-kube-api-access-mvrfr\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:07.456475 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.456391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj82v\" (UniqueName: \"kubernetes.io/projected/7a275f51-6e4c-4ae1-927f-34d9a3896bb6-kube-api-access-hj82v\") pod \"console-operator-7866497494-n6ntz\" (UID: \"7a275f51-6e4c-4ae1-927f-34d9a3896bb6\") " pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.504606 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.504553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:07.641404 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.641315 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-n6ntz"] Jul 10 23:00:07.644993 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:07.644967 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a275f51_6e4c_4ae1_927f_34d9a3896bb6.slice/crio-05c3d25c586c7fe28127df042a7e7b1270359fc9166f35c9414f7f454b4b824c WatchSource:0}: Error finding container 05c3d25c586c7fe28127df042a7e7b1270359fc9166f35c9414f7f454b4b824c: Status 404 returned error can't find the container with id 05c3d25c586c7fe28127df042a7e7b1270359fc9166f35c9414f7f454b4b824c Jul 10 23:00:07.791835 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.791795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-n6ntz" event={"ID":"7a275f51-6e4c-4ae1-927f-34d9a3896bb6","Type":"ContainerStarted","Data":"05c3d25c586c7fe28127df042a7e7b1270359fc9166f35c9414f7f454b4b824c"} Jul 10 23:00:07.850677 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.850643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:07.850870 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.850690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.850870 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.850818 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 23:00:07.850870 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.850821 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 23:00:07.850870 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.850850 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4f7d955b-8bmts: secret "image-registry-tls" not found Jul 10 23:00:07.851068 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.850890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:07.851068 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.850902 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:08.850882302 +0000 UTC m=+263.347315173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : secret "router-metrics-certs-default" not found Jul 10 23:00:07.851068 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.850991 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls podName:9ea764bf-3b2a-4e1b-b762-0337a3230fba nodeName:}" failed. No retries permitted until 2026-07-10 23:00:08.850975492 +0000 UTC m=+263.347408355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls") pod "image-registry-c4f7d955b-8bmts" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba") : secret "image-registry-tls" not found Jul 10 23:00:07.851068 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.851007 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:08.851001568 +0000 UTC m=+263.347434426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : configmap references non-existent config key: service-ca.crt Jul 10 23:00:07.951848 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:07.951762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:07.951996 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.951902 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 23:00:07.951996 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:07.951960 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls podName:5755482d-d48c-429c-be1c-236114dadb85 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:08.951944238 +0000 UTC m=+263.448377098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls") pod "cluster-samples-operator-65db858894-d6kd6" (UID: "5755482d-d48c-429c-be1c-236114dadb85") : secret "samples-operator-tls" not found Jul 10 23:00:08.860186 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:08.860142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:08.860186 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:08.860189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:08.860685 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:08.860243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:08.860685 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:08.860338 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 23:00:08.860685 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:08.860346 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 23:00:08.860685 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:08.860374 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4f7d955b-8bmts: secret "image-registry-tls" not found Jul 10 23:00:08.860685 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:08.860390 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:10.860376689 +0000 UTC m=+265.356809547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : secret "router-metrics-certs-default" not found Jul 10 23:00:08.860685 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:08.860427 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls podName:9ea764bf-3b2a-4e1b-b762-0337a3230fba nodeName:}" failed. No retries permitted until 2026-07-10 23:00:10.860410297 +0000 UTC m=+265.356843174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls") pod "image-registry-c4f7d955b-8bmts" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba") : secret "image-registry-tls" not found Jul 10 23:00:08.860685 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:08.860446 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:10.860436279 +0000 UTC m=+265.356869138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : configmap references non-existent config key: service-ca.crt Jul 10 23:00:08.961599 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:08.961564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:08.961812 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:08.961737 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 23:00:08.961812 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:08.961810 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls podName:5755482d-d48c-429c-be1c-236114dadb85 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:10.961792595 +0000 UTC m=+265.458225453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls") pod "cluster-samples-operator-65db858894-d6kd6" (UID: "5755482d-d48c-429c-be1c-236114dadb85") : secret "samples-operator-tls" not found Jul 10 23:00:10.803934 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:10.803898 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/0.log" Jul 10 23:00:10.804368 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:10.803949 2578 generic.go:356] "Generic (PLEG): container finished" podID="7a275f51-6e4c-4ae1-927f-34d9a3896bb6" containerID="07fe63f90930d283f597bed520a835840c84c9a8e71c4018ce8c78a64d17f46f" exitCode=255 Jul 10 23:00:10.804368 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:10.804044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-n6ntz" event={"ID":"7a275f51-6e4c-4ae1-927f-34d9a3896bb6","Type":"ContainerDied","Data":"07fe63f90930d283f597bed520a835840c84c9a8e71c4018ce8c78a64d17f46f"} Jul 10 23:00:10.804500 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:10.804480 2578 scope.go:117] "RemoveContainer" containerID="07fe63f90930d283f597bed520a835840c84c9a8e71c4018ce8c78a64d17f46f" Jul 10 23:00:10.881194 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:10.881152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:10.881357 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:10.881208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:10.881357 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:10.881299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:10.881357 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:10.881303 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 23:00:10.881357 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:10.881325 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4f7d955b-8bmts: secret "image-registry-tls" not found Jul 10 23:00:10.881357 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:10.881351 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 23:00:10.881503 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:10.881381 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls podName:9ea764bf-3b2a-4e1b-b762-0337a3230fba nodeName:}" failed. No retries permitted until 2026-07-10 23:00:14.881365222 +0000 UTC m=+269.377798080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls") pod "image-registry-c4f7d955b-8bmts" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba") : secret "image-registry-tls" not found Jul 10 23:00:10.881503 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:10.881401 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:14.881387797 +0000 UTC m=+269.377820654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : secret "router-metrics-certs-default" not found Jul 10 23:00:10.881503 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:10.881419 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:14.881412966 +0000 UTC m=+269.377845823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : configmap references non-existent config key: service-ca.crt Jul 10 23:00:10.981726 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:10.981678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:10.981915 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:10.981810 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 23:00:10.981915 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:10.981875 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls podName:5755482d-d48c-429c-be1c-236114dadb85 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:14.981855988 +0000 UTC m=+269.478288864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls") pod "cluster-samples-operator-65db858894-d6kd6" (UID: "5755482d-d48c-429c-be1c-236114dadb85") : secret "samples-operator-tls" not found Jul 10 23:00:11.808144 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:11.808117 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:00:11.808540 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:11.808436 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/0.log" Jul 10 23:00:11.808540 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:11.808466 2578 generic.go:356] "Generic (PLEG): container finished" podID="7a275f51-6e4c-4ae1-927f-34d9a3896bb6" containerID="118bc180b6e743a5a8481191bedc7f29ad31add6700036635ed3095b4765db2b" exitCode=255 Jul 10 23:00:11.808540 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:11.808504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-n6ntz" event={"ID":"7a275f51-6e4c-4ae1-927f-34d9a3896bb6","Type":"ContainerDied","Data":"118bc180b6e743a5a8481191bedc7f29ad31add6700036635ed3095b4765db2b"} Jul 10 23:00:11.808642 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:11.808547 2578 scope.go:117] "RemoveContainer" containerID="07fe63f90930d283f597bed520a835840c84c9a8e71c4018ce8c78a64d17f46f" Jul 10 23:00:11.808796 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:11.808777 2578 scope.go:117] "RemoveContainer" containerID="118bc180b6e743a5a8481191bedc7f29ad31add6700036635ed3095b4765db2b" Jul 10 23:00:11.808989 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:11.808961 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-n6ntz_openshift-console-operator(7a275f51-6e4c-4ae1-927f-34d9a3896bb6)\"" pod="openshift-console-operator/console-operator-7866497494-n6ntz" podUID="7a275f51-6e4c-4ae1-927f-34d9a3896bb6" Jul 10 23:00:12.433858 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.433821 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cqcnb"] Jul 10 23:00:12.437998 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.437979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.440370 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.440338 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 23:00:12.440660 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.440444 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q2bn6\"" Jul 10 23:00:12.441141 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.441119 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 23:00:12.441141 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.441122 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 23:00:12.441290 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.441144 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 23:00:12.456443 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.456414 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cqcnb"] Jul 10 23:00:12.597263 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.597222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.597451 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.597345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.597451 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.597386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jvnt\" (UniqueName: \"kubernetes.io/projected/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-api-access-8jvnt\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.597451 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.597408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78c7477-0287-4dc0-a489-f3c482fe328d-data-volume\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.597451 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.597439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e78c7477-0287-4dc0-a489-f3c482fe328d-crio-socket\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.698023 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.697927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.698023 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.697979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jvnt\" (UniqueName: \"kubernetes.io/projected/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-api-access-8jvnt\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.698023 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.697999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78c7477-0287-4dc0-a489-f3c482fe328d-data-volume\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.698325 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:12.698072 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 23:00:12.698325 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.698119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e78c7477-0287-4dc0-a489-f3c482fe328d-crio-socket\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.698325 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:12.698141 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:13.198127322 +0000 UTC m=+267.694560179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : configmap "kube-rbac-proxy" not found Jul 10 23:00:12.698325 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.698189 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e78c7477-0287-4dc0-a489-f3c482fe328d-crio-socket\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.698325 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.698201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.698325 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:12.698286 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 23:00:12.698509 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:12.698339 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:13.198326352 +0000 UTC m=+267.694759212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : secret "insights-runtime-extractor-tls" not found Jul 10 23:00:12.698509 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.698335 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78c7477-0287-4dc0-a489-f3c482fe328d-data-volume\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.706766 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.706739 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jvnt\" (UniqueName: \"kubernetes.io/projected/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-api-access-8jvnt\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:12.812885 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.812853 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:00:12.813239 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:12.813180 2578 scope.go:117] "RemoveContainer" containerID="118bc180b6e743a5a8481191bedc7f29ad31add6700036635ed3095b4765db2b" Jul 10 23:00:12.813335 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:12.813316 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-n6ntz_openshift-console-operator(7a275f51-6e4c-4ae1-927f-34d9a3896bb6)\"" pod="openshift-console-operator/console-operator-7866497494-n6ntz" podUID="7a275f51-6e4c-4ae1-927f-34d9a3896bb6" Jul 10 23:00:13.203266 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:13.203225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:13.203459 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:13.203315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:13.203459 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:13.203355 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 23:00:13.203459 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:13.203440 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 23:00:13.203564 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:13.203443 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:14.203426019 +0000 UTC m=+268.699858876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : configmap "kube-rbac-proxy" not found Jul 10 23:00:13.203564 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:13.203488 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:14.203477251 +0000 UTC m=+268.699910109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : secret "insights-runtime-extractor-tls" not found Jul 10 23:00:14.212040 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:14.211995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:14.212412 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:14.212100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:14.212412 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.212136 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 23:00:14.212412 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.212211 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 23:00:14.212412 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.212217 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:16.212200361 +0000 UTC m=+270.708633220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : secret "insights-runtime-extractor-tls" not found Jul 10 23:00:14.212412 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.212266 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:16.212253882 +0000 UTC m=+270.708686741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : configmap "kube-rbac-proxy" not found Jul 10 23:00:14.919003 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:14.918959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:14.919162 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:14.919058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:14.919162 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:14.919086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:14.919162 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.919156 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:22.919135245 +0000 UTC m=+277.415568125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : configmap references non-existent config key: service-ca.crt Jul 10 23:00:14.919271 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.919209 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 23:00:14.919271 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.919226 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 23:00:14.919271 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.919246 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs podName:72b247f6-05e7-4e7c-bcdd-1651a57e9123 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:22.919234628 +0000 UTC m=+277.415667486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs") pod "router-default-59b45fff4d-5hvx9" (UID: "72b247f6-05e7-4e7c-bcdd-1651a57e9123") : secret "router-metrics-certs-default" not found Jul 10 23:00:14.919271 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.919246 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4f7d955b-8bmts: secret "image-registry-tls" not found Jul 10 23:00:14.919389 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:14.919293 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls podName:9ea764bf-3b2a-4e1b-b762-0337a3230fba nodeName:}" failed. No retries permitted until 2026-07-10 23:00:22.919280123 +0000 UTC m=+277.415712983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls") pod "image-registry-c4f7d955b-8bmts" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba") : secret "image-registry-tls" not found Jul 10 23:00:15.020364 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:15.020320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:15.020530 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:15.020457 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 23:00:15.020530 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:15.020520 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls podName:5755482d-d48c-429c-be1c-236114dadb85 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:23.020504015 +0000 UTC m=+277.516936877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls") pod "cluster-samples-operator-65db858894-d6kd6" (UID: "5755482d-d48c-429c-be1c-236114dadb85") : secret "samples-operator-tls" not found Jul 10 23:00:15.231578 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:15.231494 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jg9xc_76386443-600f-4203-9262-9d5b3465cb66/dns-node-resolver/0.log" Jul 10 23:00:16.233006 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:16.232964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:16.233432 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:16.233070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:16.233432 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:16.233083 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 23:00:16.233432 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:16.233154 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:20.233131324 +0000 UTC m=+274.729564182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : secret "insights-runtime-extractor-tls" not found Jul 10 23:00:16.233432 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:16.233183 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 23:00:16.233432 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:16.233220 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:20.23321 +0000 UTC m=+274.729642858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : configmap "kube-rbac-proxy" not found Jul 10 23:00:16.235699 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:16.235674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s56qh_54b04330-58f8-4df4-9ba2-79950539353f/node-ca/0.log" Jul 10 23:00:16.829820 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:16.829752 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7fbsp_13c5e442-70d0-45ff-b81a-53dd2bc14b98/serve-healthcheck-canary/0.log" Jul 10 23:00:17.505777 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:17.505667 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:17.505777 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:17.505765 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:17.506164 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:17.506098 2578 scope.go:117] "RemoveContainer" containerID="118bc180b6e743a5a8481191bedc7f29ad31add6700036635ed3095b4765db2b" Jul 10 23:00:17.506264 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:17.506243 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-n6ntz_openshift-console-operator(7a275f51-6e4c-4ae1-927f-34d9a3896bb6)\"" pod="openshift-console-operator/console-operator-7866497494-n6ntz" podUID="7a275f51-6e4c-4ae1-927f-34d9a3896bb6" Jul 10 23:00:20.266817 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:20.266782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:20.267258 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:20.266859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:20.267258 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:20.266945 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 23:00:20.267258 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:20.266976 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 23:00:20.267258 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:20.267004 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:28.266988571 +0000 UTC m=+282.763421429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : configmap "kube-rbac-proxy" not found Jul 10 23:00:20.267258 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:20.267039 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls podName:e78c7477-0287-4dc0-a489-f3c482fe328d nodeName:}" failed. No retries permitted until 2026-07-10 23:00:28.267022524 +0000 UTC m=+282.763455385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqcnb" (UID: "e78c7477-0287-4dc0-a489-f3c482fe328d") : secret "insights-runtime-extractor-tls" not found Jul 10 23:00:22.988978 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:22.988936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:22.989363 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:22.989004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:22.989363 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:22.989024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:22.989663 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:22.989640 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72b247f6-05e7-4e7c-bcdd-1651a57e9123-service-ca-bundle\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:22.991718 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:22.991679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") pod \"image-registry-c4f7d955b-8bmts\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:22.991776 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:22.991679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/72b247f6-05e7-4e7c-bcdd-1651a57e9123-metrics-certs\") pod \"router-default-59b45fff4d-5hvx9\" (UID: \"72b247f6-05e7-4e7c-bcdd-1651a57e9123\") " pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:23.008541 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.008503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:23.020775 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.020731 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:23.090232 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.090180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:23.093327 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.093301 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5755482d-d48c-429c-be1c-236114dadb85-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-d6kd6\" (UID: \"5755482d-d48c-429c-be1c-236114dadb85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:23.098355 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.098180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" Jul 10 23:00:23.154847 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.154802 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59b45fff4d-5hvx9"] Jul 10 23:00:23.160513 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:23.160479 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b247f6_05e7_4e7c_bcdd_1651a57e9123.slice/crio-7c26a7e379dbb10aab3b44afdb494e13c658ecb82402e3336df21f1c0bd39ead WatchSource:0}: Error finding container 7c26a7e379dbb10aab3b44afdb494e13c658ecb82402e3336df21f1c0bd39ead: Status 404 returned error can't find the container with id 7c26a7e379dbb10aab3b44afdb494e13c658ecb82402e3336df21f1c0bd39ead Jul 10 23:00:23.173321 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.173296 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c4f7d955b-8bmts"] Jul 10 23:00:23.176012 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:23.175977 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea764bf_3b2a_4e1b_b762_0337a3230fba.slice/crio-513af54db54a325575b712e592eb1b4931e6b9426028e23090c3009fa1174342 WatchSource:0}: Error finding container 513af54db54a325575b712e592eb1b4931e6b9426028e23090c3009fa1174342: Status 404 returned error can't find the container with id 513af54db54a325575b712e592eb1b4931e6b9426028e23090c3009fa1174342 Jul 10 23:00:23.251205 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.251117 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6"] Jul 10 23:00:23.849867 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.849826 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" event={"ID":"9ea764bf-3b2a-4e1b-b762-0337a3230fba","Type":"ContainerStarted","Data":"5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e"} Jul 10 23:00:23.850042 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.849894 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" event={"ID":"9ea764bf-3b2a-4e1b-b762-0337a3230fba","Type":"ContainerStarted","Data":"513af54db54a325575b712e592eb1b4931e6b9426028e23090c3009fa1174342"} Jul 10 23:00:23.850042 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.849927 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:23.851680 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.851641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59b45fff4d-5hvx9" event={"ID":"72b247f6-05e7-4e7c-bcdd-1651a57e9123","Type":"ContainerStarted","Data":"6d6dec7112442c3e1d8239b3a1cdf9452e4b5b89af24b2e8a79df55b148015fe"} Jul 10 23:00:23.851849 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.851725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59b45fff4d-5hvx9" event={"ID":"72b247f6-05e7-4e7c-bcdd-1651a57e9123","Type":"ContainerStarted","Data":"7c26a7e379dbb10aab3b44afdb494e13c658ecb82402e3336df21f1c0bd39ead"} Jul 10 23:00:23.853244 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.853217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" event={"ID":"5755482d-d48c-429c-be1c-236114dadb85","Type":"ContainerStarted","Data":"9b70a4564ecad5a350e3832773a074cd9dd32f4eb3a4e25633a6105129f51628"} Jul 10 23:00:23.869726 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.869649 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" podStartSLOduration=16.869628503 podStartE2EDuration="16.869628503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:23.868337451 +0000 UTC m=+278.364770332" watchObservedRunningTime="2026-07-10 23:00:23.869628503 +0000 UTC m=+278.366061387" Jul 10 23:00:23.886393 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:23.886332 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59b45fff4d-5hvx9" podStartSLOduration=16.886306954 podStartE2EDuration="16.886306954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:23.885638495 +0000 UTC m=+278.382071386" watchObservedRunningTime="2026-07-10 23:00:23.886306954 +0000 UTC m=+278.382739835" Jul 10 23:00:24.009687 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:24.009645 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:24.012609 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:24.012563 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:24.856110 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:24.856075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:24.857521 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:24.857495 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59b45fff4d-5hvx9" Jul 10 23:00:25.860563 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:25.860514 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" event={"ID":"5755482d-d48c-429c-be1c-236114dadb85","Type":"ContainerStarted","Data":"500a3956fc482fd18aa6e4e9de719833d92fa6e0952e4157267b0330e262f794"} Jul 10 23:00:25.861117 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:25.860586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" event={"ID":"5755482d-d48c-429c-be1c-236114dadb85","Type":"ContainerStarted","Data":"a195691b29ab49aaf87030edc4432096bcec569527ab316f636dbb9cafa7f8a6"} Jul 10 23:00:25.875265 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:25.875201 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-d6kd6" podStartSLOduration=17.368194606 podStartE2EDuration="18.875177567s" totalImagesPullingTime="1.506982961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:25.874949818 +0000 UTC m=+280.371382698" watchObservedRunningTime="2026-07-10 23:00:25.875177567 +0000 UTC m=+280.371610448" Jul 10 23:00:28.334761 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:28.334694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:28.335276 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:28.334816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:28.335486 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:28.335463 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78c7477-0287-4dc0-a489-f3c482fe328d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:28.337315 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:28.337289 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78c7477-0287-4dc0-a489-f3c482fe328d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqcnb\" (UID: \"e78c7477-0287-4dc0-a489-f3c482fe328d\") " pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:28.347227 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:28.347194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cqcnb" Jul 10 23:00:28.493579 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:28.493542 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cqcnb"] Jul 10 23:00:28.497465 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:28.497434 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78c7477_0287_4dc0_a489_f3c482fe328d.slice/crio-fc4f79b436e888130e78b6c04b00410ac7801fbd4e8090da56449a95364018ae WatchSource:0}: Error finding container fc4f79b436e888130e78b6c04b00410ac7801fbd4e8090da56449a95364018ae: Status 404 returned error can't find the container with id fc4f79b436e888130e78b6c04b00410ac7801fbd4e8090da56449a95364018ae Jul 10 23:00:28.517107 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:28.517066 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pjgcr" podUID="23e16f1d-18fe-4093-a939-acb9948155f3" Jul 10 23:00:28.869780 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:28.869752 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjgcr" Jul 10 23:00:28.869947 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:28.869752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqcnb" event={"ID":"e78c7477-0287-4dc0-a489-f3c482fe328d","Type":"ContainerStarted","Data":"fc4f79b436e888130e78b6c04b00410ac7801fbd4e8090da56449a95364018ae"} Jul 10 23:00:29.942783 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:29.942749 2578 scope.go:117] "RemoveContainer" containerID="118bc180b6e743a5a8481191bedc7f29ad31add6700036635ed3095b4765db2b" Jul 10 23:00:30.881027 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:30.880997 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:00:30.881202 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:30.881068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-n6ntz" event={"ID":"7a275f51-6e4c-4ae1-927f-34d9a3896bb6","Type":"ContainerStarted","Data":"1490e51fd1d509563af9abb0114d330a5b6c3f18f33a6a11779a1fe6da22cfee"} Jul 10 23:00:30.881507 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:30.881473 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:30.898743 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:30.898330 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-n6ntz" podStartSLOduration=21.346347775 podStartE2EDuration="23.89830699s" totalImagesPullingTime="2.551959215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:30.897041687 +0000 UTC m=+285.393474568" watchObservedRunningTime="2026-07-10 23:00:30.89830699 +0000 UTC m=+285.394739872" Jul 10 23:00:31.082589 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:31.082555 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-n6ntz" Jul 10 23:00:31.864055 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:31.864016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 23:00:31.866806 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:31.866779 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e16f1d-18fe-4093-a939-acb9948155f3-metrics-tls\") pod \"dns-default-pjgcr\" (UID: \"23e16f1d-18fe-4093-a939-acb9948155f3\") " pod="openshift-dns/dns-default-pjgcr" Jul 10 23:00:31.872751 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:31.872721 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5n6l\"" Jul 10 23:00:31.880752 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:31.880699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjgcr" Jul 10 23:00:32.601291 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:32.601264 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pjgcr"] Jul 10 23:00:32.604098 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:32.604064 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e16f1d_18fe_4093_a939_acb9948155f3.slice/crio-d6e3e6db16fd0a9bb6d005fa8c21be14651927a57bbad27ec15c5e72ba5d07a5 WatchSource:0}: Error finding container d6e3e6db16fd0a9bb6d005fa8c21be14651927a57bbad27ec15c5e72ba5d07a5: Status 404 returned error can't find the container with id d6e3e6db16fd0a9bb6d005fa8c21be14651927a57bbad27ec15c5e72ba5d07a5 Jul 10 23:00:32.889776 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:32.889739 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqcnb" event={"ID":"e78c7477-0287-4dc0-a489-f3c482fe328d","Type":"ContainerStarted","Data":"7b450119edf3b7cf8b55f10fbbc850f34002d73825c828f8f52482ebb483c3a9"} Jul 10 23:00:32.890830 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:32.890802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjgcr" event={"ID":"23e16f1d-18fe-4093-a939-acb9948155f3","Type":"ContainerStarted","Data":"d6e3e6db16fd0a9bb6d005fa8c21be14651927a57bbad27ec15c5e72ba5d07a5"} Jul 10 23:00:33.897511 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:33.897467 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqcnb" event={"ID":"e78c7477-0287-4dc0-a489-f3c482fe328d","Type":"ContainerStarted","Data":"bb4bfecb709caa70439f94a03f50c93f32d8f80b8cbd96ca1ed1ce1be95316ca"} Jul 10 23:00:34.902968 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:34.902932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjgcr" event={"ID":"23e16f1d-18fe-4093-a939-acb9948155f3","Type":"ContainerStarted","Data":"337c5a41b86c11b21902b7be4018b1b92ff154c3d0108221669454c73d4004d5"} Jul 10 23:00:34.903438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:34.902985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjgcr" event={"ID":"23e16f1d-18fe-4093-a939-acb9948155f3","Type":"ContainerStarted","Data":"25fa584aa4fee3b017a00c1e26dfef8ee0338acb239818d912db6f3d290bb667"} Jul 10 23:00:34.903438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:34.903038 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pjgcr" Jul 10 23:00:34.919279 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:34.919228 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pjgcr" podStartSLOduration=252.240809829 podStartE2EDuration="4m13.919208836s" totalImagesPullingTime="1.678399007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:34.918747142 +0000 UTC m=+289.415180023" watchObservedRunningTime="2026-07-10 23:00:34.919208836 +0000 UTC m=+289.415641717" Jul 10 23:00:36.911657 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:36.911616 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqcnb" event={"ID":"e78c7477-0287-4dc0-a489-f3c482fe328d","Type":"ContainerStarted","Data":"a908084292d32a3dd310d610dd78700eceafdc19ff001c57768242f051b47e74"} Jul 10 23:00:36.927257 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:36.927201 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cqcnb" podStartSLOduration=17.713893806 podStartE2EDuration="24.927184143s" totalImagesPullingTime="7.213290337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 23:00:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:36.926877464 +0000 UTC m=+291.423310344" watchObservedRunningTime="2026-07-10 23:00:36.927184143 +0000 UTC m=+291.423617040" Jul 10 23:00:38.515380 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.515347 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c4f7d955b-8bmts"] Jul 10 23:00:38.520768 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.520666 2578 patch_prober.go:28] interesting pod/image-registry-c4f7d955b-8bmts container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 23:00:38.520920 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.520878 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" podUID="9ea764bf-3b2a-4e1b-b762-0337a3230fba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 23:00:38.555162 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.555121 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc"] Jul 10 23:00:38.557841 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.557821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" Jul 10 23:00:38.560132 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.560108 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 23:00:38.560348 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.560331 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gqccd\"" Jul 10 23:00:38.574580 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.574550 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc"] Jul 10 23:00:38.620235 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.620194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d82835c8-fef3-450c-8e82-3e990e704b73-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-82lvc\" (UID: \"d82835c8-fef3-450c-8e82-3e990e704b73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" Jul 10 23:00:38.721298 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.721261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d82835c8-fef3-450c-8e82-3e990e704b73-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-82lvc\" (UID: \"d82835c8-fef3-450c-8e82-3e990e704b73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" Jul 10 23:00:38.724016 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.723980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d82835c8-fef3-450c-8e82-3e990e704b73-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-82lvc\" (UID: \"d82835c8-fef3-450c-8e82-3e990e704b73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" Jul 10 23:00:38.867299 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.867262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" Jul 10 23:00:38.997990 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:38.997956 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc"] Jul 10 23:00:39.000892 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:39.000846 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82835c8_fef3_450c_8e82_3e990e704b73.slice/crio-7587e79035d15b2d31c887a7c4cc084e77994d184be60d979f45f180828a06e6 WatchSource:0}: Error finding container 7587e79035d15b2d31c887a7c4cc084e77994d184be60d979f45f180828a06e6: Status 404 returned error can't find the container with id 7587e79035d15b2d31c887a7c4cc084e77994d184be60d979f45f180828a06e6 Jul 10 23:00:39.924543 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:39.924499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" event={"ID":"d82835c8-fef3-450c-8e82-3e990e704b73","Type":"ContainerStarted","Data":"7587e79035d15b2d31c887a7c4cc084e77994d184be60d979f45f180828a06e6"} Jul 10 23:00:40.928954 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:40.928918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" event={"ID":"d82835c8-fef3-450c-8e82-3e990e704b73","Type":"ContainerStarted","Data":"941a8e57f337e34bbd66bbc6e19f033a79e1174422520249c34bd22968affe60"} Jul 10 23:00:40.929414 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:40.929123 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" Jul 10 23:00:40.933680 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:40.933655 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" Jul 10 23:00:40.943703 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:40.943650 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-82lvc" podStartSLOduration=1.659777183 podStartE2EDuration="2.943635824s" totalImagesPullingTime="1.283858641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:40.942120524 +0000 UTC m=+295.438553405" watchObservedRunningTime="2026-07-10 23:00:40.943635824 +0000 UTC m=+295.440068703" Jul 10 23:00:41.685199 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.685167 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-g7v8n"] Jul 10 23:00:41.688376 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.688357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.691452 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.691408 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 23:00:41.691635 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.691467 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 10 23:00:41.691635 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.691492 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 10 23:00:41.691635 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.691512 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dv2bl\"" Jul 10 23:00:41.691635 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.691516 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 23:00:41.691635 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.691567 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 23:00:41.722010 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.721972 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-g7v8n"] Jul 10 23:00:41.741567 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.741516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79eca085-5bb7-45cc-83d5-89bc84b0aeed-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.741567 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.741556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79eca085-5bb7-45cc-83d5-89bc84b0aeed-metrics-client-ca\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.741854 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.741598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcbhl\" (UniqueName: \"kubernetes.io/projected/79eca085-5bb7-45cc-83d5-89bc84b0aeed-kube-api-access-hcbhl\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.741854 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.741638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79eca085-5bb7-45cc-83d5-89bc84b0aeed-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.842558 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.842516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79eca085-5bb7-45cc-83d5-89bc84b0aeed-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.842768 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.842607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79eca085-5bb7-45cc-83d5-89bc84b0aeed-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.842768 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.842633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79eca085-5bb7-45cc-83d5-89bc84b0aeed-metrics-client-ca\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.842768 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.842656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcbhl\" (UniqueName: \"kubernetes.io/projected/79eca085-5bb7-45cc-83d5-89bc84b0aeed-kube-api-access-hcbhl\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.842768 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:41.842669 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 10 23:00:41.842768 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:41.842766 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79eca085-5bb7-45cc-83d5-89bc84b0aeed-prometheus-operator-tls podName:79eca085-5bb7-45cc-83d5-89bc84b0aeed nodeName:}" failed. No retries permitted until 2026-07-10 23:00:42.34274704 +0000 UTC m=+296.839179902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/79eca085-5bb7-45cc-83d5-89bc84b0aeed-prometheus-operator-tls") pod "prometheus-operator-64785b6675-g7v8n" (UID: "79eca085-5bb7-45cc-83d5-89bc84b0aeed") : secret "prometheus-operator-tls" not found Jul 10 23:00:41.843348 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.843320 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79eca085-5bb7-45cc-83d5-89bc84b0aeed-metrics-client-ca\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.845310 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.845282 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79eca085-5bb7-45cc-83d5-89bc84b0aeed-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:41.853308 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:41.853283 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcbhl\" (UniqueName: \"kubernetes.io/projected/79eca085-5bb7-45cc-83d5-89bc84b0aeed-kube-api-access-hcbhl\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:42.347669 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:42.347621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79eca085-5bb7-45cc-83d5-89bc84b0aeed-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:42.350196 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:42.350172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/79eca085-5bb7-45cc-83d5-89bc84b0aeed-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-g7v8n\" (UID: \"79eca085-5bb7-45cc-83d5-89bc84b0aeed\") " pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:42.620495 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:42.620405 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" Jul 10 23:00:42.763318 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:42.763287 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-g7v8n"] Jul 10 23:00:42.766701 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:42.766674 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79eca085_5bb7_45cc_83d5_89bc84b0aeed.slice/crio-2f7a8b5d8ab6d59554a90f8d9382447ca2c0d1a0e10ce6ad2b400b7100dde0ca WatchSource:0}: Error finding container 2f7a8b5d8ab6d59554a90f8d9382447ca2c0d1a0e10ce6ad2b400b7100dde0ca: Status 404 returned error can't find the container with id 2f7a8b5d8ab6d59554a90f8d9382447ca2c0d1a0e10ce6ad2b400b7100dde0ca Jul 10 23:00:42.937321 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:42.937225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" event={"ID":"79eca085-5bb7-45cc-83d5-89bc84b0aeed","Type":"ContainerStarted","Data":"2f7a8b5d8ab6d59554a90f8d9382447ca2c0d1a0e10ce6ad2b400b7100dde0ca"} Jul 10 23:00:42.943811 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:42.943778 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zktgk" podUID="3c7063b8-b242-45ff-a6b2-342d66a4cc64" Jul 10 23:00:44.908554 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:44.908473 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pjgcr" Jul 10 23:00:44.946727 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:44.946681 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" event={"ID":"79eca085-5bb7-45cc-83d5-89bc84b0aeed","Type":"ContainerStarted","Data":"9f967cf61b11e4208f3f29c6dac4085d344d6f3afe661f28ab8e7a23e6be51f8"} Jul 10 23:00:44.946859 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:44.946757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" event={"ID":"79eca085-5bb7-45cc-83d5-89bc84b0aeed","Type":"ContainerStarted","Data":"6dd03a4c1888f0843676fd572767c23eced76c67b8ffe812df4dd5dcf331cfd0"} Jul 10 23:00:44.963116 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:44.963064 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-g7v8n" podStartSLOduration=2.191420402 podStartE2EDuration="3.96304487s" totalImagesPullingTime="1.771624468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:44.961905768 +0000 UTC m=+299.458338645" watchObservedRunningTime="2026-07-10 23:00:44.96304487 +0000 UTC m=+299.459477749" Jul 10 23:00:45.819686 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:45.819661 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:00:45.821040 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:45.821014 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:00:45.827560 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:45.827533 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:00:45.828540 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:45.828514 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:00:45.831095 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:45.831073 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 23:00:47.026065 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.026028 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6"] Jul 10 23:00:47.029453 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.029429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.031666 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.031638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 23:00:47.031808 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.031687 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 23:00:47.031880 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.031862 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5prtx\"" Jul 10 23:00:47.040286 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.040260 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6"] Jul 10 23:00:47.044879 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.044851 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h2rrd"] Jul 10 23:00:47.047963 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.047945 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.050141 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.050116 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m25jt\"" Jul 10 23:00:47.050463 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.050441 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 23:00:47.050799 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.050773 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 23:00:47.050944 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.050926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 23:00:47.051229 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.051210 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-r2hnv"] Jul 10 23:00:47.054722 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.054685 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.057405 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.057383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 10 23:00:47.057533 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.057434 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 10 23:00:47.057533 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.057434 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 10 23:00:47.057647 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.057634 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zncct\"" Jul 10 23:00:47.069157 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.069129 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-r2hnv"] Jul 10 23:00:47.187573 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.187948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.187948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-textfile\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.187948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187671 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/523195ea-1d1a-43f4-b54e-f6801d549317-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.187948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ae4455a2-f444-4114-8a88-f0b48c285581-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.187948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-wtmp\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.187948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ztls\" (UniqueName: \"kubernetes.io/projected/ae4455a2-f444-4114-8a88-f0b48c285581-kube-api-access-7ztls\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.187948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mfp8\" (UniqueName: \"kubernetes.io/projected/523195ea-1d1a-43f4-b54e-f6801d549317-kube-api-access-6mfp8\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.187948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.187948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae4455a2-f444-4114-8a88-f0b48c285581-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.188343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/541e83b3-908d-4c67-a918-ef638dd8721c-root\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.188343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.187994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523195ea-1d1a-43f4-b54e-f6801d549317-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.188343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.188017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-accelerators-collector-config\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.188343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.188049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/523195ea-1d1a-43f4-b54e-f6801d549317-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.188343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.188076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/541e83b3-908d-4c67-a918-ef638dd8721c-metrics-client-ca\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.188343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.188121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-tls\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.188343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.188147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/541e83b3-908d-4c67-a918-ef638dd8721c-sys\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.188343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.188173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9pn8\" (UniqueName: \"kubernetes.io/projected/541e83b3-908d-4c67-a918-ef638dd8721c-kube-api-access-s9pn8\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.188343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.188218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.288838 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.288809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/523195ea-1d1a-43f4-b54e-f6801d549317-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.289002 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.288852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ae4455a2-f444-4114-8a88-f0b48c285581-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.289002 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.288872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-wtmp\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289002 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.288896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztls\" (UniqueName: \"kubernetes.io/projected/ae4455a2-f444-4114-8a88-f0b48c285581-kube-api-access-7ztls\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.289002 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.288924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mfp8\" (UniqueName: \"kubernetes.io/projected/523195ea-1d1a-43f4-b54e-f6801d549317-kube-api-access-6mfp8\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.289002 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.288951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.289002 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:47.288969 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-wtmp\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:47.289056 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/523195ea-1d1a-43f4-b54e-f6801d549317-openshift-state-metrics-tls podName:523195ea-1d1a-43f4-b54e-f6801d549317 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:47.789034025 +0000 UTC m=+302.285466897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/523195ea-1d1a-43f4-b54e-f6801d549317-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-qmfn6" (UID: "523195ea-1d1a-43f4-b54e-f6801d549317") : secret "openshift-state-metrics-tls" not found Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.288975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae4455a2-f444-4114-8a88-f0b48c285581-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/541e83b3-908d-4c67-a918-ef638dd8721c-root\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:47.289159 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523195ea-1d1a-43f4-b54e-f6801d549317-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289205 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/541e83b3-908d-4c67-a918-ef638dd8721c-root\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:47.289242 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-tls podName:ae4455a2-f444-4114-8a88-f0b48c285581 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:47.789222543 +0000 UTC m=+302.285655404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-r2hnv" (UID: "ae4455a2-f444-4114-8a88-f0b48c285581") : secret "kube-state-metrics-tls" not found Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289244 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ae4455a2-f444-4114-8a88-f0b48c285581-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.289301 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-accelerators-collector-config\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/523195ea-1d1a-43f4-b54e-f6801d549317-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.289659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/541e83b3-908d-4c67-a918-ef638dd8721c-metrics-client-ca\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-tls\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/541e83b3-908d-4c67-a918-ef638dd8721c-sys\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pn8\" (UniqueName: \"kubernetes.io/projected/541e83b3-908d-4c67-a918-ef638dd8721c-kube-api-access-s9pn8\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.289659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.289659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.289659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-textfile\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.290110 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289667 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae4455a2-f444-4114-8a88-f0b48c285581-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.290110 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289829 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-accelerators-collector-config\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.290110 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289874 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-textfile\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.290110 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/541e83b3-908d-4c67-a918-ef638dd8721c-metrics-client-ca\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.290110 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289963 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523195ea-1d1a-43f4-b54e-f6801d549317-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.290110 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.289977 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/541e83b3-908d-4c67-a918-ef638dd8721c-sys\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.290486 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.290456 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.292050 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.292024 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/523195ea-1d1a-43f4-b54e-f6801d549317-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.292143 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.292120 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-tls\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.292325 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.292305 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/541e83b3-908d-4c67-a918-ef638dd8721c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.292498 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.292483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.299814 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.299777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9pn8\" (UniqueName: \"kubernetes.io/projected/541e83b3-908d-4c67-a918-ef638dd8721c-kube-api-access-s9pn8\") pod \"node-exporter-h2rrd\" (UID: \"541e83b3-908d-4c67-a918-ef638dd8721c\") " pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.300005 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.299982 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ztls\" (UniqueName: \"kubernetes.io/projected/ae4455a2-f444-4114-8a88-f0b48c285581-kube-api-access-7ztls\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.300980 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.300961 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mfp8\" (UniqueName: \"kubernetes.io/projected/523195ea-1d1a-43f4-b54e-f6801d549317-kube-api-access-6mfp8\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.358888 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.358846 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h2rrd" Jul 10 23:00:47.372282 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:47.372254 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541e83b3_908d_4c67_a918_ef638dd8721c.slice/crio-a5098995bf9d80a017750ae014db4c53ffbe63647fbe313b8e324ca9090d0e44 WatchSource:0}: Error finding container a5098995bf9d80a017750ae014db4c53ffbe63647fbe313b8e324ca9090d0e44: Status 404 returned error can't find the container with id a5098995bf9d80a017750ae014db4c53ffbe63647fbe313b8e324ca9090d0e44 Jul 10 23:00:47.374665 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.374644 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 23:00:47.794477 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.794436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.794638 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.794539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/523195ea-1d1a-43f4-b54e-f6801d549317-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.797063 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.797032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae4455a2-f444-4114-8a88-f0b48c285581-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-r2hnv\" (UID: \"ae4455a2-f444-4114-8a88-f0b48c285581\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:47.797177 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.797073 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/523195ea-1d1a-43f4-b54e-f6801d549317-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qmfn6\" (UID: \"523195ea-1d1a-43f4-b54e-f6801d549317\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.939344 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.939292 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" Jul 10 23:00:47.956690 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.956648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2rrd" event={"ID":"541e83b3-908d-4c67-a918-ef638dd8721c","Type":"ContainerStarted","Data":"a5098995bf9d80a017750ae014db4c53ffbe63647fbe313b8e324ca9090d0e44"} Jul 10 23:00:47.964815 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:47.964782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" Jul 10 23:00:48.112637 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:48.112599 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6"] Jul 10 23:00:48.120301 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:48.120268 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523195ea_1d1a_43f4_b54e_f6801d549317.slice/crio-6bedc64fd2e1a25d85db6b57521f9a39c170275df7a7821e3ffca26eab4f5c2b WatchSource:0}: Error finding container 6bedc64fd2e1a25d85db6b57521f9a39c170275df7a7821e3ffca26eab4f5c2b: Status 404 returned error can't find the container with id 6bedc64fd2e1a25d85db6b57521f9a39c170275df7a7821e3ffca26eab4f5c2b Jul 10 23:00:48.142236 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:48.142197 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-r2hnv"] Jul 10 23:00:48.156341 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:48.156307 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4455a2_f444_4114_8a88_f0b48c285581.slice/crio-2b32501bd0ab1ae40a95d6013fa904c507d0c7df3f98f1ca864d42ec53c34c19 WatchSource:0}: Error finding container 2b32501bd0ab1ae40a95d6013fa904c507d0c7df3f98f1ca864d42ec53c34c19: Status 404 returned error can't find the container with id 2b32501bd0ab1ae40a95d6013fa904c507d0c7df3f98f1ca864d42ec53c34c19 Jul 10 23:00:48.522597 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:48.522519 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:00:48.963455 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:48.963410 2578 generic.go:356] "Generic (PLEG): container finished" podID="541e83b3-908d-4c67-a918-ef638dd8721c" containerID="c1a748537b13a458872097bcfa6f3e07fee9901385df9a4861acc0dc60dad9bc" exitCode=0 Jul 10 23:00:48.963874 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:48.963458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2rrd" event={"ID":"541e83b3-908d-4c67-a918-ef638dd8721c","Type":"ContainerDied","Data":"c1a748537b13a458872097bcfa6f3e07fee9901385df9a4861acc0dc60dad9bc"} Jul 10 23:00:48.966373 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:48.966260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" event={"ID":"523195ea-1d1a-43f4-b54e-f6801d549317","Type":"ContainerStarted","Data":"efa8d30e52844c0722f67ebb7d775429634c969d15586322a66757f44bd9a3cf"} Jul 10 23:00:48.966373 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:48.966337 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" event={"ID":"523195ea-1d1a-43f4-b54e-f6801d549317","Type":"ContainerStarted","Data":"33e3b6c4653e976b7055b07433f7e173dfc239ac6a85f7aa83f00ae88da2746f"} Jul 10 23:00:48.966564 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:48.966380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" event={"ID":"523195ea-1d1a-43f4-b54e-f6801d549317","Type":"ContainerStarted","Data":"6bedc64fd2e1a25d85db6b57521f9a39c170275df7a7821e3ffca26eab4f5c2b"} Jul 10 23:00:48.967852 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:48.967824 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" event={"ID":"ae4455a2-f444-4114-8a88-f0b48c285581","Type":"ContainerStarted","Data":"2b32501bd0ab1ae40a95d6013fa904c507d0c7df3f98f1ca864d42ec53c34c19"} Jul 10 23:00:49.978737 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:49.978661 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" event={"ID":"ae4455a2-f444-4114-8a88-f0b48c285581","Type":"ContainerStarted","Data":"300d262f3e588d66e17b5877f5dc6545025dd46d3262d1843a09af8ea785ae24"} Jul 10 23:00:49.979181 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:49.979108 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" event={"ID":"ae4455a2-f444-4114-8a88-f0b48c285581","Type":"ContainerStarted","Data":"f8ff2a9001308b6b7f09041af083584b4653d0362bb446bb46e0aca6e05f6a35"} Jul 10 23:00:49.983659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:49.982667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2rrd" event={"ID":"541e83b3-908d-4c67-a918-ef638dd8721c","Type":"ContainerStarted","Data":"9de72995c22301006d6c28290364d9fe035305b26b49158001160a1b68763f25"} Jul 10 23:00:49.983659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:49.982772 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2rrd" event={"ID":"541e83b3-908d-4c67-a918-ef638dd8721c","Type":"ContainerStarted","Data":"6eb532223eb091be98a9d12792246da957685fc4c0c0ef26d2cf2489a2495920"} Jul 10 23:00:49.987696 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:49.986748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" event={"ID":"523195ea-1d1a-43f4-b54e-f6801d549317","Type":"ContainerStarted","Data":"4a8ab9e0dc7ea32c65b16f377570d3f26c85a599bd8b6d485638214a61a983d9"} Jul 10 23:00:50.005926 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:50.005682 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h2rrd" podStartSLOduration=1.7038223110000001 podStartE2EDuration="3.005658153s" totalImagesPullingTime="1.228036264s" totalInitContainerRuntime="73.799578ms" isStatefulPod=true podCreationTimestamp="2026-07-10 23:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:50.004488763 +0000 UTC m=+304.500921645" watchObservedRunningTime="2026-07-10 23:00:50.005658153 +0000 UTC m=+304.502091035" Jul 10 23:00:50.027582 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:50.027522 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qmfn6" podStartSLOduration=1.48788016 podStartE2EDuration="3.027501987s" totalImagesPullingTime="1.539621827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:50.0267497 +0000 UTC m=+304.523182580" watchObservedRunningTime="2026-07-10 23:00:50.027501987 +0000 UTC m=+304.523934893" Jul 10 23:00:50.992951 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:50.992911 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" event={"ID":"ae4455a2-f444-4114-8a88-f0b48c285581","Type":"ContainerStarted","Data":"5e2bd8f4b62afff63ec993b33c23647a841c74536f76fc67bedd89ef7be95458"} Jul 10 23:00:51.012600 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.012539 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-r2hnv" podStartSLOduration=2.356766043 podStartE2EDuration="4.012521509s" totalImagesPullingTime="1.655755466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:51.011741203 +0000 UTC m=+305.508174083" watchObservedRunningTime="2026-07-10 23:00:51.012521509 +0000 UTC m=+305.508954390" Jul 10 23:00:51.347330 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.347281 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-555c8b88f4-qjz69"] Jul 10 23:00:51.350765 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.350740 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.353010 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.352986 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 23:00:51.353200 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.353186 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 10 23:00:51.353294 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.353274 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 10 23:00:51.354032 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.353994 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gx57j\"" Jul 10 23:00:51.354032 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.354027 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f0groufhq1piv\"" Jul 10 23:00:51.354232 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.354002 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 10 23:00:51.361952 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.361924 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-555c8b88f4-qjz69"] Jul 10 23:00:51.430403 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.430366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-secret-metrics-server-client-certs\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.430549 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.430410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.430549 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.430450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-metrics-server-audit-profiles\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.430549 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.430518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-client-ca-bundle\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.430549 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.430543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-secret-metrics-server-tls\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.430697 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.430565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwsqd\" (UniqueName: \"kubernetes.io/projected/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-kube-api-access-hwsqd\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.430697 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.430583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-audit-log\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.531315 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.531275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-client-ca-bundle\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.531315 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.531315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-secret-metrics-server-tls\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.531527 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.531338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwsqd\" (UniqueName: \"kubernetes.io/projected/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-kube-api-access-hwsqd\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.531527 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.531395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-audit-log\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.531527 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.531464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-secret-metrics-server-client-certs\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.531527 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.531502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.531739 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.531537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-metrics-server-audit-profiles\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.532346 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.531861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-audit-log\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.532346 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.532277 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.532644 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.532620 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-metrics-server-audit-profiles\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.534261 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.534231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-client-ca-bundle\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.534389 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.534271 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-secret-metrics-server-tls\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.534389 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.534321 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-secret-metrics-server-client-certs\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.541322 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.541294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwsqd\" (UniqueName: \"kubernetes.io/projected/5a4e1191-a2e1-4f7b-9364-ca75cdbeb613-kube-api-access-hwsqd\") pod \"metrics-server-555c8b88f4-qjz69\" (UID: \"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613\") " pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.661092 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.661006 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:00:51.817035 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.816996 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-555c8b88f4-qjz69"] Jul 10 23:00:51.819693 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.819665 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v"] Jul 10 23:00:51.821285 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:51.821255 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4e1191_a2e1_4f7b_9364_ca75cdbeb613.slice/crio-19faa1a099a66de5962558d1cfed3dd0e97b1b017d51d9f093f3ac7b579b44e0 WatchSource:0}: Error finding container 19faa1a099a66de5962558d1cfed3dd0e97b1b017d51d9f093f3ac7b579b44e0: Status 404 returned error can't find the container with id 19faa1a099a66de5962558d1cfed3dd0e97b1b017d51d9f093f3ac7b579b44e0 Jul 10 23:00:51.824588 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.824561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:51.827009 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.826987 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 23:00:51.827166 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.827019 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k2zsf\"" Jul 10 23:00:51.833449 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.833423 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v"] Jul 10 23:00:51.935796 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.935667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bxs7v\" (UID: \"d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:51.935796 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.935791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq68p\" (UniqueName: \"kubernetes.io/projected/d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4-kube-api-access-lq68p\") pod \"monitoring-plugin-5f68df7f58-bxs7v\" (UID: \"d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:51.998641 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:51.998601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" event={"ID":"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613","Type":"ContainerStarted","Data":"19faa1a099a66de5962558d1cfed3dd0e97b1b017d51d9f093f3ac7b579b44e0"} Jul 10 23:00:52.036631 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:52.036593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bxs7v\" (UID: \"d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:52.036834 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:52.036658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq68p\" (UniqueName: \"kubernetes.io/projected/d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4-kube-api-access-lq68p\") pod \"monitoring-plugin-5f68df7f58-bxs7v\" (UID: \"d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:52.036834 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:52.036787 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 10 23:00:52.036911 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:00:52.036863 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4-monitoring-plugin-cert podName:d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:52.536843192 +0000 UTC m=+307.033276050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-bxs7v" (UID: "d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4") : secret "monitoring-plugin-cert" not found Jul 10 23:00:52.045039 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:52.045009 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq68p\" (UniqueName: \"kubernetes.io/projected/d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4-kube-api-access-lq68p\") pod \"monitoring-plugin-5f68df7f58-bxs7v\" (UID: \"d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:52.541958 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:52.541921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bxs7v\" (UID: \"d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:52.544527 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:52.544501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bxs7v\" (UID: \"d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:52.739948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:52.739915 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:52.888887 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:52.888846 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v"] Jul 10 23:00:52.892662 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:00:52.892628 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d63684_7ec4_4e75_bfd6_2a1a22ace2f4.slice/crio-720beca652f53e14c98b436e089ff740101f75e31e7f9347ad8f77a0416dc56d WatchSource:0}: Error finding container 720beca652f53e14c98b436e089ff740101f75e31e7f9347ad8f77a0416dc56d: Status 404 returned error can't find the container with id 720beca652f53e14c98b436e089ff740101f75e31e7f9347ad8f77a0416dc56d Jul 10 23:00:53.006915 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:53.006874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" event={"ID":"d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4","Type":"ContainerStarted","Data":"720beca652f53e14c98b436e089ff740101f75e31e7f9347ad8f77a0416dc56d"} Jul 10 23:00:53.942556 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:53.942518 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 23:00:54.014211 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:54.014171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" event={"ID":"5a4e1191-a2e1-4f7b-9364-ca75cdbeb613","Type":"ContainerStarted","Data":"6ce26188d2a7b5769aa3dc52690f65332b6b355338181e50edbb9f287937df77"} Jul 10 23:00:54.034181 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:54.034094 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" podStartSLOduration=1.0564089779999999 podStartE2EDuration="3.034075378s" totalImagesPullingTime="1.9776664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:54.032266256 +0000 UTC m=+308.528699138" watchObservedRunningTime="2026-07-10 23:00:54.034075378 +0000 UTC m=+308.530508258" Jul 10 23:00:55.019846 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:55.019737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" event={"ID":"d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4","Type":"ContainerStarted","Data":"57ed76a05b2bdc8c2de0b15bba3f4e27dc1bef3fe76264a32903a87253882a47"} Jul 10 23:00:55.020301 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:55.019992 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:55.024837 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:55.024813 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" Jul 10 23:00:55.038172 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:00:55.038116 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bxs7v" podStartSLOduration=2.258949791 podStartE2EDuration="4.038097347s" totalImagesPullingTime="1.779147556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:55.036787403 +0000 UTC m=+309.533220285" watchObservedRunningTime="2026-07-10 23:00:55.038097347 +0000 UTC m=+309.534530258" Jul 10 23:01:03.536384 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.536334 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" podUID="9ea764bf-3b2a-4e1b-b762-0337a3230fba" containerName="registry" containerID="cri-o://5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e" gracePeriod=30 Jul 10 23:01:03.780531 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.780494 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:01:03.849389 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.849347 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-certificates\") pod \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " Jul 10 23:01:03.849594 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.849403 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea764bf-3b2a-4e1b-b762-0337a3230fba-ca-trust-extracted\") pod \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " Jul 10 23:01:03.849594 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.849448 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-image-registry-private-configuration\") pod \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " Jul 10 23:01:03.849594 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.849466 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-bound-sa-token\") pod \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " Jul 10 23:01:03.849594 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.849489 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") pod \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " Jul 10 23:01:03.849594 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.849504 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-trusted-ca\") pod \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " Jul 10 23:01:03.849594 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.849532 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-installation-pull-secrets\") pod \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " Jul 10 23:01:03.849928 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.849727 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrm6k\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-kube-api-access-mrm6k\") pod \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\" (UID: \"9ea764bf-3b2a-4e1b-b762-0337a3230fba\") " Jul 10 23:01:03.850057 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.850013 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9ea764bf-3b2a-4e1b-b762-0337a3230fba" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 23:01:03.850196 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.850161 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9ea764bf-3b2a-4e1b-b762-0337a3230fba" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 23:01:03.852291 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.852232 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9ea764bf-3b2a-4e1b-b762-0337a3230fba" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 23:01:03.852480 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.852356 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-kube-api-access-mrm6k" (OuterVolumeSpecName: "kube-api-access-mrm6k") pod "9ea764bf-3b2a-4e1b-b762-0337a3230fba" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba"). InnerVolumeSpecName "kube-api-access-mrm6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:01:03.852480 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.852423 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9ea764bf-3b2a-4e1b-b762-0337a3230fba" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 23:01:03.852587 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.852563 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9ea764bf-3b2a-4e1b-b762-0337a3230fba" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:01:03.852623 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.852579 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9ea764bf-3b2a-4e1b-b762-0337a3230fba" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:01:03.858826 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.858791 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea764bf-3b2a-4e1b-b762-0337a3230fba-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9ea764bf-3b2a-4e1b-b762-0337a3230fba" (UID: "9ea764bf-3b2a-4e1b-b762-0337a3230fba"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 23:01:03.950312 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.950277 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-image-registry-private-configuration\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:01:03.950312 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.950303 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-bound-sa-token\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:01:03.950312 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.950313 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-tls\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:01:03.950312 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.950321 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-trusted-ca\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:01:03.950558 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.950329 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea764bf-3b2a-4e1b-b762-0337a3230fba-installation-pull-secrets\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:01:03.950558 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.950339 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrm6k\" (UniqueName: \"kubernetes.io/projected/9ea764bf-3b2a-4e1b-b762-0337a3230fba-kube-api-access-mrm6k\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:01:03.950558 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.950348 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea764bf-3b2a-4e1b-b762-0337a3230fba-registry-certificates\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:01:03.950558 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:03.950356 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea764bf-3b2a-4e1b-b762-0337a3230fba-ca-trust-extracted\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:01:04.052630 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:04.052593 2578 generic.go:356] "Generic (PLEG): container finished" podID="9ea764bf-3b2a-4e1b-b762-0337a3230fba" containerID="5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e" exitCode=0 Jul 10 23:01:04.052630 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:04.052633 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" Jul 10 23:01:04.052843 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:04.052685 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" event={"ID":"9ea764bf-3b2a-4e1b-b762-0337a3230fba","Type":"ContainerDied","Data":"5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e"} Jul 10 23:01:04.052843 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:04.052749 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c4f7d955b-8bmts" event={"ID":"9ea764bf-3b2a-4e1b-b762-0337a3230fba","Type":"ContainerDied","Data":"513af54db54a325575b712e592eb1b4931e6b9426028e23090c3009fa1174342"} Jul 10 23:01:04.052843 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:04.052772 2578 scope.go:117] "RemoveContainer" containerID="5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e" Jul 10 23:01:04.061217 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:04.061196 2578 scope.go:117] "RemoveContainer" containerID="5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e" Jul 10 23:01:04.061535 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:01:04.061509 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e\": container with ID starting with 5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e not found: ID does not exist" containerID="5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e" Jul 10 23:01:04.061645 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:04.061546 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e"} err="failed to get container status \"5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e\": rpc error: code = NotFound desc = could not find container \"5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e\": container with ID starting with 5ca4b702fac53b2896487c6eca9bf502b9976bf1a650a6ad553dc9f7b2cb696e not found: ID does not exist" Jul 10 23:01:04.069074 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:04.069042 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c4f7d955b-8bmts"] Jul 10 23:01:04.075842 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:04.075810 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c4f7d955b-8bmts"] Jul 10 23:01:05.947194 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:05.947160 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea764bf-3b2a-4e1b-b762-0337a3230fba" path="/var/lib/kubelet/pods/9ea764bf-3b2a-4e1b-b762-0337a3230fba/volumes" Jul 10 23:01:11.661570 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:11.661527 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:01:11.662099 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:11.661609 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:01:31.666778 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:31.666741 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:01:31.670612 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:31.670580 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-555c8b88f4-qjz69" Jul 10 23:01:59.819424 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:59.819381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 23:01:59.821880 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:59.821850 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c7063b8-b242-45ff-a6b2-342d66a4cc64-metrics-certs\") pod \"network-metrics-daemon-zktgk\" (UID: \"3c7063b8-b242-45ff-a6b2-342d66a4cc64\") " pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 23:01:59.946242 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:59.946203 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jr855\"" Jul 10 23:01:59.954024 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:01:59.953993 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zktgk" Jul 10 23:02:00.089958 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:00.089866 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zktgk"] Jul 10 23:02:00.093179 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:02:00.093140 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7063b8_b242_45ff_a6b2_342d66a4cc64.slice/crio-404ac87a23b460a0d3c50071987833323525d9d865b7f4e4c2354b2614409987 WatchSource:0}: Error finding container 404ac87a23b460a0d3c50071987833323525d9d865b7f4e4c2354b2614409987: Status 404 returned error can't find the container with id 404ac87a23b460a0d3c50071987833323525d9d865b7f4e4c2354b2614409987 Jul 10 23:02:00.258567 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:00.258531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zktgk" event={"ID":"3c7063b8-b242-45ff-a6b2-342d66a4cc64","Type":"ContainerStarted","Data":"404ac87a23b460a0d3c50071987833323525d9d865b7f4e4c2354b2614409987"} Jul 10 23:02:01.264569 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:01.264535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zktgk" event={"ID":"3c7063b8-b242-45ff-a6b2-342d66a4cc64","Type":"ContainerStarted","Data":"2301aa38edfb9b223b601aab4c5509506af8a05aaa217ce3a44e68aabac17c22"} Jul 10 23:02:01.264906 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:01.264638 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zktgk" event={"ID":"3c7063b8-b242-45ff-a6b2-342d66a4cc64","Type":"ContainerStarted","Data":"b8771d7f59ef2bb1d0dd88e005373a28d343e465b7c790ec32d86e51b6c09005"} Jul 10 23:02:01.282260 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:01.282206 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zktgk" podStartSLOduration=374.28181945 podStartE2EDuration="6m15.282187844s" totalImagesPullingTime="1.000368394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:02:01.280975573 +0000 UTC m=+375.777408456" watchObservedRunningTime="2026-07-10 23:02:01.282187844 +0000 UTC m=+375.778620726" Jul 10 23:02:52.856094 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:52.856056 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d"] Jul 10 23:02:52.856561 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:52.856364 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea764bf-3b2a-4e1b-b762-0337a3230fba" containerName="registry" Jul 10 23:02:52.856561 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:52.856376 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea764bf-3b2a-4e1b-b762-0337a3230fba" containerName="registry" Jul 10 23:02:52.856561 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:52.856436 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea764bf-3b2a-4e1b-b762-0337a3230fba" containerName="registry" Jul 10 23:02:52.859579 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:52.859559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:52.861623 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:52.861599 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 23:02:52.861623 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:52.861613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z8v4s\"" Jul 10 23:02:52.861839 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:52.861608 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 23:02:52.867096 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:52.866627 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d"] Jul 10 23:02:53.029771 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.029697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.029948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.029835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmrkj\" (UniqueName: \"kubernetes.io/projected/25f4319c-0167-4fb8-9c21-b41e4d3de80b-kube-api-access-rmrkj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.029948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.029895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.131098 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.131005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmrkj\" (UniqueName: \"kubernetes.io/projected/25f4319c-0167-4fb8-9c21-b41e4d3de80b-kube-api-access-rmrkj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.131098 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.131045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.131320 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.131186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.131529 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.131494 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.131649 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.131567 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.138716 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.138670 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmrkj\" (UniqueName: \"kubernetes.io/projected/25f4319c-0167-4fb8-9c21-b41e4d3de80b-kube-api-access-rmrkj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.170719 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.170679 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:02:53.304642 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.304611 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d"] Jul 10 23:02:53.308106 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:02:53.308069 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f4319c_0167_4fb8_9c21_b41e4d3de80b.slice/crio-3b44d0034650c8696f15c043891c3863b6a45b04da978deaa061a0690bd38155 WatchSource:0}: Error finding container 3b44d0034650c8696f15c043891c3863b6a45b04da978deaa061a0690bd38155: Status 404 returned error can't find the container with id 3b44d0034650c8696f15c043891c3863b6a45b04da978deaa061a0690bd38155 Jul 10 23:02:53.461528 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:02:53.461433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" event={"ID":"25f4319c-0167-4fb8-9c21-b41e4d3de80b","Type":"ContainerStarted","Data":"3b44d0034650c8696f15c043891c3863b6a45b04da978deaa061a0690bd38155"} Jul 10 23:03:00.489559 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:00.489523 2578 generic.go:356] "Generic (PLEG): container finished" podID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerID="1bdb21d751d487cce4e2f77b2cd3a0db2cf2cf2e6efac3b652868c66f1c5af31" exitCode=0 Jul 10 23:03:00.489986 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:00.489566 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" event={"ID":"25f4319c-0167-4fb8-9c21-b41e4d3de80b","Type":"ContainerDied","Data":"1bdb21d751d487cce4e2f77b2cd3a0db2cf2cf2e6efac3b652868c66f1c5af31"} Jul 10 23:03:03.504487 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:03.504450 2578 generic.go:356] "Generic (PLEG): container finished" podID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerID="80388142a760f00de16ebcf72283d321f2731cada35adfda3c7c627b41b3e9f9" exitCode=0 Jul 10 23:03:03.504891 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:03.504545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" event={"ID":"25f4319c-0167-4fb8-9c21-b41e4d3de80b","Type":"ContainerDied","Data":"80388142a760f00de16ebcf72283d321f2731cada35adfda3c7c627b41b3e9f9"} Jul 10 23:03:11.547035 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:11.547002 2578 generic.go:356] "Generic (PLEG): container finished" podID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerID="199cacdce55ca92e6c0b93c3fe9a4e11c18d43d01d5f62cbdd8bfd186a75128c" exitCode=0 Jul 10 23:03:11.547432 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:11.547057 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" event={"ID":"25f4319c-0167-4fb8-9c21-b41e4d3de80b","Type":"ContainerDied","Data":"199cacdce55ca92e6c0b93c3fe9a4e11c18d43d01d5f62cbdd8bfd186a75128c"} Jul 10 23:03:12.677050 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.677024 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:03:12.693282 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.693252 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-util\") pod \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " Jul 10 23:03:12.693437 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.693311 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-bundle\") pod \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " Jul 10 23:03:12.693437 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.693350 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmrkj\" (UniqueName: \"kubernetes.io/projected/25f4319c-0167-4fb8-9c21-b41e4d3de80b-kube-api-access-rmrkj\") pod \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\" (UID: \"25f4319c-0167-4fb8-9c21-b41e4d3de80b\") " Jul 10 23:03:12.694134 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.694099 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-bundle" (OuterVolumeSpecName: "bundle") pod "25f4319c-0167-4fb8-9c21-b41e4d3de80b" (UID: "25f4319c-0167-4fb8-9c21-b41e4d3de80b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 23:03:12.696041 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.696007 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f4319c-0167-4fb8-9c21-b41e4d3de80b-kube-api-access-rmrkj" (OuterVolumeSpecName: "kube-api-access-rmrkj") pod "25f4319c-0167-4fb8-9c21-b41e4d3de80b" (UID: "25f4319c-0167-4fb8-9c21-b41e4d3de80b"). InnerVolumeSpecName "kube-api-access-rmrkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:03:12.698356 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.698326 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-util" (OuterVolumeSpecName: "util") pod "25f4319c-0167-4fb8-9c21-b41e4d3de80b" (UID: "25f4319c-0167-4fb8-9c21-b41e4d3de80b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 23:03:12.794911 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.794871 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-util\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:03:12.794911 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.794905 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f4319c-0167-4fb8-9c21-b41e4d3de80b-bundle\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:03:12.795117 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:12.794919 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmrkj\" (UniqueName: \"kubernetes.io/projected/25f4319c-0167-4fb8-9c21-b41e4d3de80b-kube-api-access-rmrkj\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:03:13.561298 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:13.561267 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" Jul 10 23:03:13.561439 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:13.561254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404ps6d" event={"ID":"25f4319c-0167-4fb8-9c21-b41e4d3de80b","Type":"ContainerDied","Data":"3b44d0034650c8696f15c043891c3863b6a45b04da978deaa061a0690bd38155"} Jul 10 23:03:13.561499 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:13.561470 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b44d0034650c8696f15c043891c3863b6a45b04da978deaa061a0690bd38155" Jul 10 23:03:20.685135 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.685100 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j"] Jul 10 23:03:20.685691 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.685449 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerName="extract" Jul 10 23:03:20.685691 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.685468 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerName="extract" Jul 10 23:03:20.685691 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.685482 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerName="pull" Jul 10 23:03:20.685691 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.685495 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerName="pull" Jul 10 23:03:20.685691 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.685523 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerName="util" Jul 10 23:03:20.685691 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.685531 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerName="util" Jul 10 23:03:20.685691 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.685602 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="25f4319c-0167-4fb8-9c21-b41e4d3de80b" containerName="extract" Jul 10 23:03:20.688892 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.688870 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" Jul 10 23:03:20.691253 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.691226 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 10 23:03:20.691369 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.691282 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v9cln\"" Jul 10 23:03:20.691369 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.691304 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 10 23:03:20.699848 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.699824 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j"] Jul 10 23:03:20.756276 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.756243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcc08e09-f9f1-4079-92dd-0a140306262d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmq7j\" (UID: \"fcc08e09-f9f1-4079-92dd-0a140306262d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" Jul 10 23:03:20.756276 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.756288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcgpt\" (UniqueName: \"kubernetes.io/projected/fcc08e09-f9f1-4079-92dd-0a140306262d-kube-api-access-mcgpt\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmq7j\" (UID: \"fcc08e09-f9f1-4079-92dd-0a140306262d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" Jul 10 23:03:20.857556 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.857514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcc08e09-f9f1-4079-92dd-0a140306262d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmq7j\" (UID: \"fcc08e09-f9f1-4079-92dd-0a140306262d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" Jul 10 23:03:20.857751 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.857563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcgpt\" (UniqueName: \"kubernetes.io/projected/fcc08e09-f9f1-4079-92dd-0a140306262d-kube-api-access-mcgpt\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmq7j\" (UID: \"fcc08e09-f9f1-4079-92dd-0a140306262d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" Jul 10 23:03:20.857970 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.857950 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcc08e09-f9f1-4079-92dd-0a140306262d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmq7j\" (UID: \"fcc08e09-f9f1-4079-92dd-0a140306262d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" Jul 10 23:03:20.870106 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.870073 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcgpt\" (UniqueName: \"kubernetes.io/projected/fcc08e09-f9f1-4079-92dd-0a140306262d-kube-api-access-mcgpt\") pod \"cert-manager-operator-controller-manager-55c444bf86-dmq7j\" (UID: \"fcc08e09-f9f1-4079-92dd-0a140306262d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" Jul 10 23:03:20.998580 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:20.998489 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" Jul 10 23:03:21.136509 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:21.136474 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j"] Jul 10 23:03:21.140254 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:03:21.140221 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc08e09_f9f1_4079_92dd_0a140306262d.slice/crio-2d782e5c5c92500817f4365dc32af4fb3ada37dc0d02c907f00d00455215c5d0 WatchSource:0}: Error finding container 2d782e5c5c92500817f4365dc32af4fb3ada37dc0d02c907f00d00455215c5d0: Status 404 returned error can't find the container with id 2d782e5c5c92500817f4365dc32af4fb3ada37dc0d02c907f00d00455215c5d0 Jul 10 23:03:21.595425 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:21.595385 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" event={"ID":"fcc08e09-f9f1-4079-92dd-0a140306262d","Type":"ContainerStarted","Data":"2d782e5c5c92500817f4365dc32af4fb3ada37dc0d02c907f00d00455215c5d0"} Jul 10 23:03:23.606087 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:23.606051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" event={"ID":"fcc08e09-f9f1-4079-92dd-0a140306262d","Type":"ContainerStarted","Data":"40028ec093bc1d165a847a0cf0897beefbf8f971490f078ed9ffd8e0ae1387f8"} Jul 10 23:03:23.625951 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:23.625899 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dmq7j" podStartSLOduration=2.013766318 podStartE2EDuration="3.625881148s" totalImagesPullingTime="1.61211483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:03:23.623596586 +0000 UTC m=+458.120029463" watchObservedRunningTime="2026-07-10 23:03:23.625881148 +0000 UTC m=+458.122314028" Jul 10 23:03:24.711084 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.711043 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c8qp4"] Jul 10 23:03:24.714947 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.714922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:24.717690 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.717655 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 23:03:24.718121 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.717922 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 23:03:24.718121 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.717993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jl8qt\"" Jul 10 23:03:24.742107 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.742073 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c8qp4"] Jul 10 23:03:24.791902 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.791871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e22b4dc1-4007-4728-9c58-c7c52e83c755-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c8qp4\" (UID: \"e22b4dc1-4007-4728-9c58-c7c52e83c755\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:24.792052 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.791923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g66v7\" (UniqueName: \"kubernetes.io/projected/e22b4dc1-4007-4728-9c58-c7c52e83c755-kube-api-access-g66v7\") pod \"cert-manager-webhook-6486ffd997-c8qp4\" (UID: \"e22b4dc1-4007-4728-9c58-c7c52e83c755\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:24.892820 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.892783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e22b4dc1-4007-4728-9c58-c7c52e83c755-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c8qp4\" (UID: \"e22b4dc1-4007-4728-9c58-c7c52e83c755\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:24.892993 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.892835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g66v7\" (UniqueName: \"kubernetes.io/projected/e22b4dc1-4007-4728-9c58-c7c52e83c755-kube-api-access-g66v7\") pod \"cert-manager-webhook-6486ffd997-c8qp4\" (UID: \"e22b4dc1-4007-4728-9c58-c7c52e83c755\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:24.900341 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.900307 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e22b4dc1-4007-4728-9c58-c7c52e83c755-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c8qp4\" (UID: \"e22b4dc1-4007-4728-9c58-c7c52e83c755\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:24.903940 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:24.903911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g66v7\" (UniqueName: \"kubernetes.io/projected/e22b4dc1-4007-4728-9c58-c7c52e83c755-kube-api-access-g66v7\") pod \"cert-manager-webhook-6486ffd997-c8qp4\" (UID: \"e22b4dc1-4007-4728-9c58-c7c52e83c755\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:25.025026 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:25.024921 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:25.159042 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:25.159015 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c8qp4"] Jul 10 23:03:25.161902 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:03:25.161873 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode22b4dc1_4007_4728_9c58_c7c52e83c755.slice/crio-26716bf0702ad03ed3fdd0acf3ed80c0f02d47f3fbdb389764c11c004755512f WatchSource:0}: Error finding container 26716bf0702ad03ed3fdd0acf3ed80c0f02d47f3fbdb389764c11c004755512f: Status 404 returned error can't find the container with id 26716bf0702ad03ed3fdd0acf3ed80c0f02d47f3fbdb389764c11c004755512f Jul 10 23:03:25.616455 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:25.616419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" event={"ID":"e22b4dc1-4007-4728-9c58-c7c52e83c755","Type":"ContainerStarted","Data":"26716bf0702ad03ed3fdd0acf3ed80c0f02d47f3fbdb389764c11c004755512f"} Jul 10 23:03:28.633068 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:28.632971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" event={"ID":"e22b4dc1-4007-4728-9c58-c7c52e83c755","Type":"ContainerStarted","Data":"f96a557d0db9b9c7577856b3d6ac958f8052b6d9dab388ae724342f554912e55"} Jul 10 23:03:28.633430 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:28.633117 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:28.648076 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:28.648025 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" podStartSLOduration=1.4542785249999999 podStartE2EDuration="4.648008382s" totalImagesPullingTime="3.193729857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:03:28.647170403 +0000 UTC m=+463.143603285" watchObservedRunningTime="2026-07-10 23:03:28.648008382 +0000 UTC m=+463.144441262" Jul 10 23:03:31.691195 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.691159 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb"] Jul 10 23:03:31.694549 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.694528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" Jul 10 23:03:31.696662 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.696637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5gzd5\"" Jul 10 23:03:31.700837 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.700803 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb"] Jul 10 23:03:31.750178 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.750137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acf2a6d6-7df8-4939-8b1b-fc90d2095e1e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9cxvb\" (UID: \"acf2a6d6-7df8-4939-8b1b-fc90d2095e1e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" Jul 10 23:03:31.750357 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.750198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6npmj\" (UniqueName: \"kubernetes.io/projected/acf2a6d6-7df8-4939-8b1b-fc90d2095e1e-kube-api-access-6npmj\") pod \"cert-manager-cainjector-559cdd8c87-9cxvb\" (UID: \"acf2a6d6-7df8-4939-8b1b-fc90d2095e1e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" Jul 10 23:03:31.851161 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.851121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acf2a6d6-7df8-4939-8b1b-fc90d2095e1e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9cxvb\" (UID: \"acf2a6d6-7df8-4939-8b1b-fc90d2095e1e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" Jul 10 23:03:31.851330 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.851189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6npmj\" (UniqueName: \"kubernetes.io/projected/acf2a6d6-7df8-4939-8b1b-fc90d2095e1e-kube-api-access-6npmj\") pod \"cert-manager-cainjector-559cdd8c87-9cxvb\" (UID: \"acf2a6d6-7df8-4939-8b1b-fc90d2095e1e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" Jul 10 23:03:31.859843 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.859808 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/acf2a6d6-7df8-4939-8b1b-fc90d2095e1e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9cxvb\" (UID: \"acf2a6d6-7df8-4939-8b1b-fc90d2095e1e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" Jul 10 23:03:31.859993 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:31.859904 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6npmj\" (UniqueName: \"kubernetes.io/projected/acf2a6d6-7df8-4939-8b1b-fc90d2095e1e-kube-api-access-6npmj\") pod \"cert-manager-cainjector-559cdd8c87-9cxvb\" (UID: \"acf2a6d6-7df8-4939-8b1b-fc90d2095e1e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" Jul 10 23:03:32.004665 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:32.004569 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" Jul 10 23:03:32.139334 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:32.139299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb"] Jul 10 23:03:32.142411 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:03:32.142380 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacf2a6d6_7df8_4939_8b1b_fc90d2095e1e.slice/crio-02950fcb781f66ff417dcb689c46ef286c142b99c662f0b8f9a4a208bbbd6e93 WatchSource:0}: Error finding container 02950fcb781f66ff417dcb689c46ef286c142b99c662f0b8f9a4a208bbbd6e93: Status 404 returned error can't find the container with id 02950fcb781f66ff417dcb689c46ef286c142b99c662f0b8f9a4a208bbbd6e93 Jul 10 23:03:32.651213 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:32.651182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" event={"ID":"acf2a6d6-7df8-4939-8b1b-fc90d2095e1e","Type":"ContainerStarted","Data":"9c351f3f2ab7cc16d38808ba0d9dfc1f93cd16348e36f9ec278c95b9c7d2c46f"} Jul 10 23:03:32.651213 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:32.651220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" event={"ID":"acf2a6d6-7df8-4939-8b1b-fc90d2095e1e","Type":"ContainerStarted","Data":"02950fcb781f66ff417dcb689c46ef286c142b99c662f0b8f9a4a208bbbd6e93"} Jul 10 23:03:32.666140 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:32.666082 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9cxvb" podStartSLOduration=1.66606432 podStartE2EDuration="1.66606432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:03:32.665519902 +0000 UTC m=+467.161952798" watchObservedRunningTime="2026-07-10 23:03:32.66606432 +0000 UTC m=+467.162497210" Jul 10 23:03:34.640092 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:34.640061 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c8qp4" Jul 10 23:03:54.902854 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:54.902816 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm"] Jul 10 23:03:54.906644 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:54.906622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:54.909018 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:54.908995 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 23:03:54.909146 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:54.908999 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z8v4s\"" Jul 10 23:03:54.909741 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:54.909722 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 23:03:54.913536 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:54.913503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm"] Jul 10 23:03:55.042152 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.042109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.042330 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.042160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.042330 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.042277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpw4q\" (UniqueName: \"kubernetes.io/projected/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-kube-api-access-wpw4q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.143679 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.143620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw4q\" (UniqueName: \"kubernetes.io/projected/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-kube-api-access-wpw4q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.143905 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.143740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.143905 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.143782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.144141 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.144118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.144218 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.144148 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.154468 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.154404 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpw4q\" (UniqueName: \"kubernetes.io/projected/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-kube-api-access-wpw4q\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.217254 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.217221 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:55.358852 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.358816 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm"] Jul 10 23:03:55.362005 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:03:55.361977 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a30f89_cc2b_460e_b2a2_abcdeb3d1c50.slice/crio-af36d6f55f9271f93005455274af10bc6463685a6a9c65d3e48d11308a6f6199 WatchSource:0}: Error finding container af36d6f55f9271f93005455274af10bc6463685a6a9c65d3e48d11308a6f6199: Status 404 returned error can't find the container with id af36d6f55f9271f93005455274af10bc6463685a6a9c65d3e48d11308a6f6199 Jul 10 23:03:55.756088 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.756000 2578 generic.go:356] "Generic (PLEG): container finished" podID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerID="e4772152a7f60a8a9e6c0f9b9b84ddfc62d1ca8be164304fd967dc51ea060b58" exitCode=0 Jul 10 23:03:55.756088 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.756062 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" event={"ID":"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50","Type":"ContainerDied","Data":"e4772152a7f60a8a9e6c0f9b9b84ddfc62d1ca8be164304fd967dc51ea060b58"} Jul 10 23:03:55.756298 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:55.756124 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" event={"ID":"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50","Type":"ContainerStarted","Data":"af36d6f55f9271f93005455274af10bc6463685a6a9c65d3e48d11308a6f6199"} Jul 10 23:03:56.762264 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:56.762181 2578 generic.go:356] "Generic (PLEG): container finished" podID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerID="3b7d1ea938975ae79477aed52212e207f348985f5625da4232ce0508f081b97e" exitCode=0 Jul 10 23:03:56.762680 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:56.762263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" event={"ID":"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50","Type":"ContainerDied","Data":"3b7d1ea938975ae79477aed52212e207f348985f5625da4232ce0508f081b97e"} Jul 10 23:03:57.769215 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:57.769179 2578 generic.go:356] "Generic (PLEG): container finished" podID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerID="5e900e79122d80133bfad4543ce7404430ea5028330f0aa87921409603b41f80" exitCode=0 Jul 10 23:03:57.769602 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:57.769244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" event={"ID":"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50","Type":"ContainerDied","Data":"5e900e79122d80133bfad4543ce7404430ea5028330f0aa87921409603b41f80"} Jul 10 23:03:58.905850 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:58.905822 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:59.074822 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.074791 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-bundle\") pod \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " Jul 10 23:03:59.075004 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.074830 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpw4q\" (UniqueName: \"kubernetes.io/projected/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-kube-api-access-wpw4q\") pod \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " Jul 10 23:03:59.075004 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.074896 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-util\") pod \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\" (UID: \"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50\") " Jul 10 23:03:59.075580 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.075541 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-bundle" (OuterVolumeSpecName: "bundle") pod "87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" (UID: "87a30f89-cc2b-460e-b2a2-abcdeb3d1c50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 23:03:59.077052 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.077027 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-kube-api-access-wpw4q" (OuterVolumeSpecName: "kube-api-access-wpw4q") pod "87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" (UID: "87a30f89-cc2b-460e-b2a2-abcdeb3d1c50"). InnerVolumeSpecName "kube-api-access-wpw4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:03:59.082789 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.082756 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-util" (OuterVolumeSpecName: "util") pod "87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" (UID: "87a30f89-cc2b-460e-b2a2-abcdeb3d1c50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 23:03:59.175415 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.175375 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-util\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:03:59.175415 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.175410 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-bundle\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:03:59.175415 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.175420 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpw4q\" (UniqueName: \"kubernetes.io/projected/87a30f89-cc2b-460e-b2a2-abcdeb3d1c50-kube-api-access-wpw4q\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:03:59.510088 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.510008 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2"] Jul 10 23:03:59.510342 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.510330 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerName="pull" Jul 10 23:03:59.510389 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.510344 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerName="pull" Jul 10 23:03:59.510389 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.510357 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerName="util" Jul 10 23:03:59.510389 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.510363 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerName="util" Jul 10 23:03:59.510389 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.510370 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerName="extract" Jul 10 23:03:59.510389 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.510376 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerName="extract" Jul 10 23:03:59.510534 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.510427 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a30f89-cc2b-460e-b2a2-abcdeb3d1c50" containerName="extract" Jul 10 23:03:59.514734 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.514687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.517054 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.517028 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 23:03:59.517175 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.517038 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 23:03:59.517940 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.517919 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 23:03:59.518069 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.518039 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 23:03:59.518179 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.518084 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 23:03:59.518179 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.518039 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n9bdm\"" Jul 10 23:03:59.522970 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.522943 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2"] Jul 10 23:03:59.680418 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.680378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-cert\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.680599 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.680431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-manager-config\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.680599 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.680484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54v5q\" (UniqueName: \"kubernetes.io/projected/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-kube-api-access-54v5q\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.680599 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.680511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-metrics-cert\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.780460 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.780387 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" Jul 10 23:03:59.780460 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.780417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2zzmm" event={"ID":"87a30f89-cc2b-460e-b2a2-abcdeb3d1c50","Type":"ContainerDied","Data":"af36d6f55f9271f93005455274af10bc6463685a6a9c65d3e48d11308a6f6199"} Jul 10 23:03:59.780623 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.780463 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af36d6f55f9271f93005455274af10bc6463685a6a9c65d3e48d11308a6f6199" Jul 10 23:03:59.781042 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.781024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-manager-config\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.781113 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.781060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54v5q\" (UniqueName: \"kubernetes.io/projected/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-kube-api-access-54v5q\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.781113 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.781086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-metrics-cert\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.781208 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.781128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-cert\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.781918 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.781847 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-manager-config\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.783924 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.783901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-cert\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.784017 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.783911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-metrics-cert\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.803264 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.803232 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54v5q\" (UniqueName: \"kubernetes.io/projected/a53dcb55-a7ed-412c-a9a7-17a3a216a9c0-kube-api-access-54v5q\") pod \"lws-controller-manager-85bcb67fdb-wj5x2\" (UID: \"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0\") " pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.824437 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.824395 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:03:59.970745 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:03:59.970688 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2"] Jul 10 23:03:59.974907 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:03:59.974860 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53dcb55_a7ed_412c_a9a7_17a3a216a9c0.slice/crio-8631341aec5f8734709c104bb32e06dd165c50374bf07a44bb5193e2f582a99a WatchSource:0}: Error finding container 8631341aec5f8734709c104bb32e06dd165c50374bf07a44bb5193e2f582a99a: Status 404 returned error can't find the container with id 8631341aec5f8734709c104bb32e06dd165c50374bf07a44bb5193e2f582a99a Jul 10 23:04:00.788383 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:00.788339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" event={"ID":"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0","Type":"ContainerStarted","Data":"8631341aec5f8734709c104bb32e06dd165c50374bf07a44bb5193e2f582a99a"} Jul 10 23:04:02.799436 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:02.799399 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" event={"ID":"a53dcb55-a7ed-412c-a9a7-17a3a216a9c0","Type":"ContainerStarted","Data":"69e9dccb9e73c01a17be647288a07eae0c088dd6047b92a921bc012ec89c40fe"} Jul 10 23:04:02.799843 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:02.799484 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:04:02.814468 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:02.814417 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" podStartSLOduration=1.359651365 podStartE2EDuration="3.814402658s" totalImagesPullingTime="2.454751293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:02.813190306 +0000 UTC m=+497.309623190" watchObservedRunningTime="2026-07-10 23:04:02.814402658 +0000 UTC m=+497.310835538" Jul 10 23:04:09.208095 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.208052 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86"] Jul 10 23:04:09.211523 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.211499 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.214040 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.214014 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 23:04:09.214040 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.214053 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-94qk9\"" Jul 10 23:04:09.214265 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.214073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 23:04:09.214265 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.214139 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 23:04:09.214265 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.214165 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 23:04:09.232156 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.232126 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86"] Jul 10 23:04:09.361787 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.361662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrccq\" (UniqueName: \"kubernetes.io/projected/906ab0f4-04ab-41e2-97d3-437fd1c36227-kube-api-access-hrccq\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.361787 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.361779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/906ab0f4-04ab-41e2-97d3-437fd1c36227-manifests\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.362061 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.361808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/906ab0f4-04ab-41e2-97d3-437fd1c36227-webhook-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.362061 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.361825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/906ab0f4-04ab-41e2-97d3-437fd1c36227-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.362061 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.361914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/906ab0f4-04ab-41e2-97d3-437fd1c36227-tmp\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.462756 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.462637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrccq\" (UniqueName: \"kubernetes.io/projected/906ab0f4-04ab-41e2-97d3-437fd1c36227-kube-api-access-hrccq\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.462756 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.462693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/906ab0f4-04ab-41e2-97d3-437fd1c36227-manifests\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.462756 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.462742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/906ab0f4-04ab-41e2-97d3-437fd1c36227-webhook-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.462756 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.462760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/906ab0f4-04ab-41e2-97d3-437fd1c36227-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.463001 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.462789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/906ab0f4-04ab-41e2-97d3-437fd1c36227-tmp\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.463188 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.463162 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/906ab0f4-04ab-41e2-97d3-437fd1c36227-manifests\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.465324 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.465294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/906ab0f4-04ab-41e2-97d3-437fd1c36227-tmp\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.465507 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.465486 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/906ab0f4-04ab-41e2-97d3-437fd1c36227-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.465552 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.465514 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/906ab0f4-04ab-41e2-97d3-437fd1c36227-webhook-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.470968 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.470941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrccq\" (UniqueName: \"kubernetes.io/projected/906ab0f4-04ab-41e2-97d3-437fd1c36227-kube-api-access-hrccq\") pod \"opendatahub-operator-controller-manager-58bf55498c-xmn86\" (UID: \"906ab0f4-04ab-41e2-97d3-437fd1c36227\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.522002 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.521958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:09.667856 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.667743 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86"] Jul 10 23:04:09.671010 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:04:09.670983 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906ab0f4_04ab_41e2_97d3_437fd1c36227.slice/crio-a8ae9fa3377db1e2349484ca74fb2b016939f989afb5cd939d3309a3f8d13d26 WatchSource:0}: Error finding container a8ae9fa3377db1e2349484ca74fb2b016939f989afb5cd939d3309a3f8d13d26: Status 404 returned error can't find the container with id a8ae9fa3377db1e2349484ca74fb2b016939f989afb5cd939d3309a3f8d13d26 Jul 10 23:04:09.833343 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:09.833307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" event={"ID":"906ab0f4-04ab-41e2-97d3-437fd1c36227","Type":"ContainerStarted","Data":"a8ae9fa3377db1e2349484ca74fb2b016939f989afb5cd939d3309a3f8d13d26"} Jul 10 23:04:12.851291 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:12.851251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" event={"ID":"906ab0f4-04ab-41e2-97d3-437fd1c36227","Type":"ContainerStarted","Data":"bd853dee8150b844b6022816d2e3e1b786e0e3f4e3eec427621164663dd7d04d"} Jul 10 23:04:13.806885 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:13.806855 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85bcb67fdb-wj5x2" Jul 10 23:04:13.857574 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:13.857539 2578 generic.go:356] "Generic (PLEG): container finished" podID="906ab0f4-04ab-41e2-97d3-437fd1c36227" containerID="bd853dee8150b844b6022816d2e3e1b786e0e3f4e3eec427621164663dd7d04d" exitCode=0 Jul 10 23:04:13.858057 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:13.857614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" event={"ID":"906ab0f4-04ab-41e2-97d3-437fd1c36227","Type":"ContainerDied","Data":"bd853dee8150b844b6022816d2e3e1b786e0e3f4e3eec427621164663dd7d04d"} Jul 10 23:04:14.863871 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:14.863838 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" event={"ID":"906ab0f4-04ab-41e2-97d3-437fd1c36227","Type":"ContainerStarted","Data":"4a676528ee3719ecff4b57c553088d54d2b52176314f01987f3e351e494bd4c1"} Jul 10 23:04:14.864257 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:14.863921 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:14.885977 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:14.885916 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" podStartSLOduration=1.3956895120000001 podStartE2EDuration="5.885892471s" totalImagesPullingTime="3.407752479s" totalInitContainerRuntime="1.08245048s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:14.884465663 +0000 UTC m=+509.380898557" watchObservedRunningTime="2026-07-10 23:04:14.885892471 +0000 UTC m=+509.382325352" Jul 10 23:04:25.871321 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:25.871288 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-xmn86" Jul 10 23:04:36.598659 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.598571 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z"] Jul 10 23:04:36.616385 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.616352 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z"] Jul 10 23:04:36.616570 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.616505 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.618658 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.618625 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 23:04:36.618944 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.618916 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 23:04:36.619031 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.618992 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 23:04:36.619092 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.619053 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-blj7j\"" Jul 10 23:04:36.619092 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.618925 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 23:04:36.675864 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.675829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da68992-da71-4c7e-8d1f-75836a26404c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.676042 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.675868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2da68992-da71-4c7e-8d1f-75836a26404c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.676042 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.675896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2da68992-da71-4c7e-8d1f-75836a26404c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.676042 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.675994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2da68992-da71-4c7e-8d1f-75836a26404c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.676042 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.676034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2da68992-da71-4c7e-8d1f-75836a26404c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.676178 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.676056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da68992-da71-4c7e-8d1f-75836a26404c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.676178 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.676125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnvsq\" (UniqueName: \"kubernetes.io/projected/2da68992-da71-4c7e-8d1f-75836a26404c-kube-api-access-fnvsq\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.776952 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.776908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnvsq\" (UniqueName: \"kubernetes.io/projected/2da68992-da71-4c7e-8d1f-75836a26404c-kube-api-access-fnvsq\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.777158 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.776981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da68992-da71-4c7e-8d1f-75836a26404c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.777158 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.777006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2da68992-da71-4c7e-8d1f-75836a26404c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.777158 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.777027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2da68992-da71-4c7e-8d1f-75836a26404c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.777158 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.777104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2da68992-da71-4c7e-8d1f-75836a26404c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.777158 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.777157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2da68992-da71-4c7e-8d1f-75836a26404c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.777417 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.777187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da68992-da71-4c7e-8d1f-75836a26404c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.777684 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.777662 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2da68992-da71-4c7e-8d1f-75836a26404c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.779454 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.779431 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da68992-da71-4c7e-8d1f-75836a26404c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.779691 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.779672 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2da68992-da71-4c7e-8d1f-75836a26404c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.780014 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.779995 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2da68992-da71-4c7e-8d1f-75836a26404c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.780115 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.780059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2da68992-da71-4c7e-8d1f-75836a26404c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.785443 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.785409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnvsq\" (UniqueName: \"kubernetes.io/projected/2da68992-da71-4c7e-8d1f-75836a26404c-kube-api-access-fnvsq\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.785558 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.785499 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da68992-da71-4c7e-8d1f-75836a26404c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s5n8z\" (UID: \"2da68992-da71-4c7e-8d1f-75836a26404c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:36.926672 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:36.926584 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:37.097366 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:37.097331 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z"] Jul 10 23:04:37.102169 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:04:37.102135 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da68992_da71_4c7e_8d1f_75836a26404c.slice/crio-3286e242bf651e8771e8b01e277ad39fd9d79ef2315c621a8fb6b4f3d423eece WatchSource:0}: Error finding container 3286e242bf651e8771e8b01e277ad39fd9d79ef2315c621a8fb6b4f3d423eece: Status 404 returned error can't find the container with id 3286e242bf651e8771e8b01e277ad39fd9d79ef2315c621a8fb6b4f3d423eece Jul 10 23:04:37.973731 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:37.973630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" event={"ID":"2da68992-da71-4c7e-8d1f-75836a26404c","Type":"ContainerStarted","Data":"3286e242bf651e8771e8b01e277ad39fd9d79ef2315c621a8fb6b4f3d423eece"} Jul 10 23:04:39.477359 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:39.477324 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 10 23:04:39.477605 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:39.477394 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 10 23:04:39.985310 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:39.985271 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" event={"ID":"2da68992-da71-4c7e-8d1f-75836a26404c","Type":"ContainerStarted","Data":"9de7f5a46c2363966333f0fc4fcb7d3227c0f0811e408d7b59f8aeb4a744d78a"} Jul 10 23:04:39.985513 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:39.985389 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:04:40.023187 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:40.023128 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" podStartSLOduration=1.650241792 podStartE2EDuration="4.023110476s" totalImagesPullingTime="2.372868684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:40.021962679 +0000 UTC m=+534.518395583" watchObservedRunningTime="2026-07-10 23:04:40.023110476 +0000 UTC m=+534.519543358" Jul 10 23:04:40.993874 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:04:40.993821 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s5n8z" Jul 10 23:05:45.849971 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:05:45.849932 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:05:45.849971 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:05:45.849973 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:05:45.856829 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:05:45.856808 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:05:45.857038 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:05:45.857021 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:07:22.608542 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.608505 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:07:22.612113 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.612090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:07:22.614499 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.614465 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6pg8v\"" Jul 10 23:07:22.614499 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.614481 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 10 23:07:22.615297 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.615279 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 23:07:22.615412 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.615312 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 23:07:22.620033 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.620015 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:07:22.649801 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.649758 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:07:22.734081 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.734042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/640a031b-a121-47b9-96ca-1e2222c672da-config-file\") pod \"limitador-limitador-54d6d988d5-v9qfz\" (UID: \"640a031b-a121-47b9-96ca-1e2222c672da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:07:22.734262 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.734091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b54rk\" (UniqueName: \"kubernetes.io/projected/640a031b-a121-47b9-96ca-1e2222c672da-kube-api-access-b54rk\") pod \"limitador-limitador-54d6d988d5-v9qfz\" (UID: \"640a031b-a121-47b9-96ca-1e2222c672da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:07:22.835275 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.835238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/640a031b-a121-47b9-96ca-1e2222c672da-config-file\") pod \"limitador-limitador-54d6d988d5-v9qfz\" (UID: \"640a031b-a121-47b9-96ca-1e2222c672da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:07:22.835469 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.835278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b54rk\" (UniqueName: \"kubernetes.io/projected/640a031b-a121-47b9-96ca-1e2222c672da-kube-api-access-b54rk\") pod \"limitador-limitador-54d6d988d5-v9qfz\" (UID: \"640a031b-a121-47b9-96ca-1e2222c672da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:07:22.836005 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.835985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/640a031b-a121-47b9-96ca-1e2222c672da-config-file\") pod \"limitador-limitador-54d6d988d5-v9qfz\" (UID: \"640a031b-a121-47b9-96ca-1e2222c672da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:07:22.843344 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.843314 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b54rk\" (UniqueName: \"kubernetes.io/projected/640a031b-a121-47b9-96ca-1e2222c672da-kube-api-access-b54rk\") pod \"limitador-limitador-54d6d988d5-v9qfz\" (UID: \"640a031b-a121-47b9-96ca-1e2222c672da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:07:22.924599 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:22.924505 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:07:23.059001 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:23.058973 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:07:23.061485 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:07:23.061448 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640a031b_a121_47b9_96ca_1e2222c672da.slice/crio-677143709cf482f79fa9af8504d36ce7bdd675040ffa3cfc72627b0c6d8bdac7 WatchSource:0}: Error finding container 677143709cf482f79fa9af8504d36ce7bdd675040ffa3cfc72627b0c6d8bdac7: Status 404 returned error can't find the container with id 677143709cf482f79fa9af8504d36ce7bdd675040ffa3cfc72627b0c6d8bdac7 Jul 10 23:07:23.063315 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:23.063290 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 23:07:23.740733 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:23.740679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" event={"ID":"640a031b-a121-47b9-96ca-1e2222c672da","Type":"ContainerStarted","Data":"677143709cf482f79fa9af8504d36ce7bdd675040ffa3cfc72627b0c6d8bdac7"} Jul 10 23:07:25.752155 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:25.752119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" event={"ID":"640a031b-a121-47b9-96ca-1e2222c672da","Type":"ContainerStarted","Data":"43f5f1eab43ff25e5264f5f43af77d25f2267c2486ecdabbe0a552251a4167ea"} Jul 10 23:07:25.752597 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:25.752237 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:07:25.768071 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:25.768015 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" podStartSLOduration=1.24057749 podStartE2EDuration="3.767996529s" totalImagesPullingTime="2.527419039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:07:25.765663463 +0000 UTC m=+700.262096343" watchObservedRunningTime="2026-07-10 23:07:25.767996529 +0000 UTC m=+700.264429408" Jul 10 23:07:36.758487 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:07:36.758404 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-v9qfz" Jul 10 23:08:35.219020 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:08:35.218972 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:08:52.214970 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:08:52.214937 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:09:06.920869 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:06.920783 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:09:27.327845 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.327806 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp"] Jul 10 23:09:27.335047 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.331828 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.335652 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.335626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9b85h\"" Jul 10 23:09:27.335781 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.335626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 10 23:09:27.335781 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.335675 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 23:09:27.335781 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.335740 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 23:09:27.341900 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.341497 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp"] Jul 10 23:09:27.407934 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.407901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjwrk\" (UniqueName: \"kubernetes.io/projected/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-kube-api-access-gjwrk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.408111 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.407990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.408111 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.408010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.408111 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.408024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.408111 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.408052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.408264 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.408113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.508925 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.508891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.508925 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.508928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.509196 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.508943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.509196 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.509001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.509196 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.509080 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.509196 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.509116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjwrk\" (UniqueName: \"kubernetes.io/projected/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-kube-api-access-gjwrk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.509405 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.509372 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.509462 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.509405 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.509462 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.509430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.511739 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.511692 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.511948 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.511926 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.516466 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.516442 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjwrk\" (UniqueName: \"kubernetes.io/projected/7080f7e7-1ca0-46fa-83d9-2a84e13482fd-kube-api-access-gjwrk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cmhp\" (UID: \"7080f7e7-1ca0-46fa-83d9-2a84e13482fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.646511 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.646420 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:27.788576 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:27.788541 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp"] Jul 10 23:09:27.792373 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:09:27.792338 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7080f7e7_1ca0_46fa_83d9_2a84e13482fd.slice/crio-1b0fefb54f233d5b993f697232f8324c1d1c9c2cec3737ee78de5b65102a5698 WatchSource:0}: Error finding container 1b0fefb54f233d5b993f697232f8324c1d1c9c2cec3737ee78de5b65102a5698: Status 404 returned error can't find the container with id 1b0fefb54f233d5b993f697232f8324c1d1c9c2cec3737ee78de5b65102a5698 Jul 10 23:09:28.321678 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:28.321635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" event={"ID":"7080f7e7-1ca0-46fa-83d9-2a84e13482fd","Type":"ContainerStarted","Data":"1b0fefb54f233d5b993f697232f8324c1d1c9c2cec3737ee78de5b65102a5698"} Jul 10 23:09:28.525543 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:28.525508 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:09:29.328310 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:29.328277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" event={"ID":"7080f7e7-1ca0-46fa-83d9-2a84e13482fd","Type":"ContainerStarted","Data":"c16bb322c1dbec7d9d63a889f88f13edc48fa2768255af23930fc56f88030c05"} Jul 10 23:09:29.344941 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:29.344893 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" podStartSLOduration=1.309855285 podStartE2EDuration="2.344877674s" totalImagesPullingTime="1.035022389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:09:29.344181059 +0000 UTC m=+823.840613941" watchObservedRunningTime="2026-07-10 23:09:29.344877674 +0000 UTC m=+823.841310532" Jul 10 23:09:37.646577 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:37.646541 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:37.647026 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:37.646608 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:37.659165 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:37.659140 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:38.382753 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:38.382722 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cmhp" Jul 10 23:09:39.337785 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:39.337749 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:09:46.017368 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:46.017327 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:09:57.923785 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:57.923746 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q"] Jul 10 23:09:57.927334 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:57.927307 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:57.929639 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:57.929617 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 10 23:09:57.936949 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:57.936925 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q"] Jul 10 23:09:58.089964 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.089923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.090148 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.089984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.090148 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.090010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.090148 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.090064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.090148 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.090097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.090148 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.090118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4bvd\" (UniqueName: \"kubernetes.io/projected/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-kube-api-access-z4bvd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.191397 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.191299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4bvd\" (UniqueName: \"kubernetes.io/projected/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-kube-api-access-z4bvd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.191397 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.191355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.191638 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.191402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.191638 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.191421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.191638 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.191596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.191827 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.191646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.191924 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.191900 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.191985 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.191941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.192057 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.192037 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.193969 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.193942 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.194186 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.194170 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.198392 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.198365 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4bvd\" (UniqueName: \"kubernetes.io/projected/98658394-0b89-41fd-aeb6-fb7e0ca8ee4d-kube-api-access-z4bvd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q\" (UID: \"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.237491 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.237448 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:09:58.376974 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.376881 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q"] Jul 10 23:09:58.379919 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:09:58.379889 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98658394_0b89_41fd_aeb6_fb7e0ca8ee4d.slice/crio-db784100dcb725d656fb0b9a55def51f99277fabcbba6bd34b209998708a45cf WatchSource:0}: Error finding container db784100dcb725d656fb0b9a55def51f99277fabcbba6bd34b209998708a45cf: Status 404 returned error can't find the container with id db784100dcb725d656fb0b9a55def51f99277fabcbba6bd34b209998708a45cf Jul 10 23:09:58.464766 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:58.464656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" event={"ID":"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d","Type":"ContainerStarted","Data":"db784100dcb725d656fb0b9a55def51f99277fabcbba6bd34b209998708a45cf"} Jul 10 23:09:59.471184 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:59.471139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" event={"ID":"98658394-0b89-41fd-aeb6-fb7e0ca8ee4d","Type":"ContainerStarted","Data":"d4c778c904ae9c3953ffd19e844f2c524417d67e1d6fdf983272ab955f632e6b"} Jul 10 23:09:59.488337 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:09:59.488282 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" podStartSLOduration=2.298184309 podStartE2EDuration="2.488266287s" totalImagesPullingTime="190.081978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:09:59.486737882 +0000 UTC m=+853.983170762" watchObservedRunningTime="2026-07-10 23:09:59.488266287 +0000 UTC m=+853.984699201" Jul 10 23:10:00.621273 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:10:00.621232 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:10:08.238596 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:10:08.238550 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:10:08.239040 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:10:08.238848 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:10:08.251474 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:10:08.251443 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:10:08.526446 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:10:08.526358 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q" Jul 10 23:10:45.878950 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:10:45.878921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:10:45.879956 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:10:45.879933 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:10:45.885964 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:10:45.885939 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:10:45.886764 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:10:45.886740 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:12:13.121508 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:12:13.121419 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:12:22.319811 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:12:22.319776 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:12:32.715925 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:12:32.715885 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:12:42.318556 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:12:42.318509 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:12:53.719555 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:12:53.719507 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:13:59.445379 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:13:59.445340 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:14:09.127569 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:14:09.127529 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:14:20.122491 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:14:20.122446 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:14:27.823173 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:14:27.823137 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:14:38.825828 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:14:38.825787 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:14:48.711546 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:14:48.711496 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:15:01.011451 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:15:01.011417 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:15:11.319769 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:15:11.319678 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:15:32.334966 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:15:32.334928 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:15:44.031892 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:15:44.031851 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:15:45.911777 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:15:45.911746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:15:45.914281 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:15:45.914255 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:15:45.925316 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:15:45.925285 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:15:45.927601 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:15:45.927580 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:16:08.129612 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:16:08.129574 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:16:18.617025 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:16:18.616985 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:16:34.535843 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:16:34.535809 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:16:44.634465 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:16:44.634429 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:16:54.323379 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:16:54.323345 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:17:04.025348 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:17:04.025312 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:17:14.132145 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:17:14.132108 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:19:01.123579 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:19:01.123538 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:19:13.531325 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:19:13.531281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:19:24.521050 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:19:24.521015 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:19:36.126133 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:19:36.126096 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:19:47.728473 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:19:47.728432 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:19:58.222952 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:19:58.222921 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:20:08.147063 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:20:08.147023 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:20:17.917494 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:20:17.917456 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:20:29.017660 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:20:29.017621 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:20:38.221151 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:20:38.221109 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:20:45.949247 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:20:45.949216 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:20:45.952957 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:20:45.952928 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:20:45.956628 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:20:45.956604 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:20:45.960371 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:20:45.960347 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:20:49.022054 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:20:49.022018 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:21:13.229219 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:21:13.229133 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:21:20.527335 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:21:20.527295 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:21:30.414276 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:21:30.414235 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:21:39.915438 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:21:39.915397 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:21:57.816862 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:21:57.816822 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:22:11.524412 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:22:11.524375 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:22:20.315474 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:22:20.315433 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:22:34.325949 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:22:34.325912 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:22:43.612490 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:22:43.612448 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:22:57.023264 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:22:57.023225 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:23:05.424253 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:23:05.424212 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:23:17.317425 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:23:17.317393 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:23:26.517056 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:23:26.517014 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:23:39.818915 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:23:39.818869 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:23:48.018958 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:23:48.018902 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:23:59.715261 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:23:59.715222 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:24:12.013047 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:24:12.012959 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:24:21.113650 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:24:21.113613 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:24:35.014088 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:24:35.014047 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:24:48.827278 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:24:48.827239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:24:58.712346 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:24:58.712307 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:25:10.818979 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:25:10.818941 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:25:21.408295 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:25:21.408259 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:25:45.978150 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:25:45.978067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:25:45.983021 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:25:45.982998 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:25:45.985617 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:25:45.985592 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:25:45.990386 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:25:45.990364 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:26:57.715464 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:26:57.715413 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:27:06.621334 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:27:06.621233 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:27:19.817935 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:27:19.817894 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:27:28.212971 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:27:28.212928 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:28:00.312510 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:28:00.312471 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:28:12.716773 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:28:12.716736 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:28:32.411758 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:28:32.411696 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:28:46.913135 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:28:46.913090 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:29:26.415378 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:29:26.415339 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:29:47.127931 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:29:47.127891 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:30:02.121919 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:30:02.121883 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:30:46.007045 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:30:46.007011 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:30:46.014793 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:30:46.014759 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:30:46.014972 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:30:46.014953 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:30:46.021699 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:30:46.021676 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:30:49.327323 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:30:49.327279 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:31:00.830944 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:31:00.830901 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:31:12.816779 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:31:12.816737 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:31:51.112611 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:31:51.112569 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:32:06.009008 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:32:06.008970 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:32:19.413232 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:32:19.413195 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:33:00.619214 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:33:00.619178 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:33:15.218989 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:33:15.218894 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:33:28.715927 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:33:28.715893 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:33:39.915521 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:33:39.915479 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:33:52.127490 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:33:52.127450 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:34:04.522457 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:34:04.522350 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:34:16.711207 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:34:16.711168 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:34:43.012518 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:34:43.012483 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:35:06.812091 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:35:06.812055 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:35:24.816231 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:35:24.816190 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:35:42.920176 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:35:42.920129 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:35:46.035628 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:35:46.035592 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:35:46.049585 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:35:46.049554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:35:46.052073 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:35:46.052047 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:35:46.058816 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:35:46.058792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:36:00.809326 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:00.809282 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:36:15.618180 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:15.618096 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:36:37.012851 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:37.012817 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:36:53.309182 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:53.309145 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:36:54.831213 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:54.831176 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm"] Jul 10 23:36:54.834416 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:54.834400 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:54.836437 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:54.836415 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f5848c\"/\"kube-root-ca.crt\"" Jul 10 23:36:54.837112 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:54.837089 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f5848c\"/\"sub-test-model-f5848c-kserve-self-signed-certs\"" Jul 10 23:36:54.837221 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:54.837099 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f5848c\"/\"openshift-service-ca.crt\"" Jul 10 23:36:54.837221 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:54.837209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f5848c\"/\"default-dockercfg-2ftxv\"" Jul 10 23:36:54.844500 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:54.844476 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm"] Jul 10 23:36:55.024216 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.024174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-tmp-dir\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.024216 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.024220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-dshm\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.024422 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.024237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abce0723-1104-43b3-9cc9-f8d1252e2b82-tls-certs\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.024422 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.024301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-model-cache\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.024422 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.024366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv9d5\" (UniqueName: \"kubernetes.io/projected/abce0723-1104-43b3-9cc9-f8d1252e2b82-kube-api-access-nv9d5\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.024422 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.024405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-home\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.125781 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.125677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-tmp-dir\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.125781 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.125747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-dshm\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.125781 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.125773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abce0723-1104-43b3-9cc9-f8d1252e2b82-tls-certs\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.126051 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.125802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-model-cache\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.126051 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.125851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv9d5\" (UniqueName: \"kubernetes.io/projected/abce0723-1104-43b3-9cc9-f8d1252e2b82-kube-api-access-nv9d5\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.126051 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.125928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-home\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.126183 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.126134 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-tmp-dir\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.126248 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.126196 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-model-cache\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.126703 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.126683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-home\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.128207 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.128185 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-dshm\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.128633 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.128609 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abce0723-1104-43b3-9cc9-f8d1252e2b82-tls-certs\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.133480 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.133457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv9d5\" (UniqueName: \"kubernetes.io/projected/abce0723-1104-43b3-9cc9-f8d1252e2b82-kube-api-access-nv9d5\") pod \"sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.144428 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.144399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:36:55.286600 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:55.286573 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm"] Jul 10 23:36:55.289277 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:36:55.289248 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabce0723_1104_43b3_9cc9_f8d1252e2b82.slice/crio-38e823cad0759df7943660c4e6542a75dce57549525e99c7762ef263ac2d8b22 WatchSource:0}: Error finding container 38e823cad0759df7943660c4e6542a75dce57549525e99c7762ef263ac2d8b22: Status 404 returned error can't find the container with id 38e823cad0759df7943660c4e6542a75dce57549525e99c7762ef263ac2d8b22 Jul 10 23:36:56.129192 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:56.129160 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" event={"ID":"abce0723-1104-43b3-9cc9-f8d1252e2b82","Type":"ContainerStarted","Data":"f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e"} Jul 10 23:36:56.129657 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:56.129200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" event={"ID":"abce0723-1104-43b3-9cc9-f8d1252e2b82","Type":"ContainerStarted","Data":"38e823cad0759df7943660c4e6542a75dce57549525e99c7762ef263ac2d8b22"} Jul 10 23:36:56.148470 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:36:56.148412 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" podStartSLOduration=2.148394236 podStartE2EDuration="2.148394236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:36:56.14719631 +0000 UTC m=+2470.643629191" watchObservedRunningTime="2026-07-10 23:36:56.148394236 +0000 UTC m=+2470.644827173" Jul 10 23:37:05.144808 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:37:05.144763 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:37:05.145254 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:37:05.144849 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:37:05.157717 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:37:05.157683 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:37:05.182461 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:37:05.182435 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:37:09.515867 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:37:09.515823 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:37:56.014932 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:37:56.014890 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:38:11.912723 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:11.912680 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:38:31.325313 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:31.325270 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:38:37.952314 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:37.952245 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm"] Jul 10 23:38:52.912841 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:52.912800 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:38:52.974428 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:52.974388 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" podUID="abce0723-1104-43b3-9cc9-f8d1252e2b82" containerName="main" containerID="cri-o://f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e" gracePeriod=45 Jul 10 23:38:53.229280 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.229249 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:38:53.289680 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.289645 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-tmp-dir\") pod \"abce0723-1104-43b3-9cc9-f8d1252e2b82\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " Jul 10 23:38:53.289853 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.289726 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abce0723-1104-43b3-9cc9-f8d1252e2b82-tls-certs\") pod \"abce0723-1104-43b3-9cc9-f8d1252e2b82\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " Jul 10 23:38:53.289853 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.289751 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-model-cache\") pod \"abce0723-1104-43b3-9cc9-f8d1252e2b82\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " Jul 10 23:38:53.289853 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.289785 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-home\") pod \"abce0723-1104-43b3-9cc9-f8d1252e2b82\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " Jul 10 23:38:53.289853 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.289822 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-dshm\") pod \"abce0723-1104-43b3-9cc9-f8d1252e2b82\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " Jul 10 23:38:53.289853 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.289845 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv9d5\" (UniqueName: \"kubernetes.io/projected/abce0723-1104-43b3-9cc9-f8d1252e2b82-kube-api-access-nv9d5\") pod \"abce0723-1104-43b3-9cc9-f8d1252e2b82\" (UID: \"abce0723-1104-43b3-9cc9-f8d1252e2b82\") " Jul 10 23:38:53.290083 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.290016 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "abce0723-1104-43b3-9cc9-f8d1252e2b82" (UID: "abce0723-1104-43b3-9cc9-f8d1252e2b82"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 23:38:53.290083 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.290036 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-model-cache" (OuterVolumeSpecName: "model-cache") pod "abce0723-1104-43b3-9cc9-f8d1252e2b82" (UID: "abce0723-1104-43b3-9cc9-f8d1252e2b82"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 23:38:53.290083 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.290061 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-home" (OuterVolumeSpecName: "home") pod "abce0723-1104-43b3-9cc9-f8d1252e2b82" (UID: "abce0723-1104-43b3-9cc9-f8d1252e2b82"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 23:38:53.292275 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.292247 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-dshm" (OuterVolumeSpecName: "dshm") pod "abce0723-1104-43b3-9cc9-f8d1252e2b82" (UID: "abce0723-1104-43b3-9cc9-f8d1252e2b82"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 23:38:53.292275 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.292265 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abce0723-1104-43b3-9cc9-f8d1252e2b82-kube-api-access-nv9d5" (OuterVolumeSpecName: "kube-api-access-nv9d5") pod "abce0723-1104-43b3-9cc9-f8d1252e2b82" (UID: "abce0723-1104-43b3-9cc9-f8d1252e2b82"). InnerVolumeSpecName "kube-api-access-nv9d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:38:53.292424 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.292296 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abce0723-1104-43b3-9cc9-f8d1252e2b82-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "abce0723-1104-43b3-9cc9-f8d1252e2b82" (UID: "abce0723-1104-43b3-9cc9-f8d1252e2b82"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 23:38:53.391191 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.391151 2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-tmp-dir\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:38:53.391191 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.391185 2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abce0723-1104-43b3-9cc9-f8d1252e2b82-tls-certs\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:38:53.391191 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.391196 2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-model-cache\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:38:53.391191 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.391204 2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-home\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:38:53.391456 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.391211 2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abce0723-1104-43b3-9cc9-f8d1252e2b82-dshm\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:38:53.391456 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.391220 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv9d5\" (UniqueName: \"kubernetes.io/projected/abce0723-1104-43b3-9cc9-f8d1252e2b82-kube-api-access-nv9d5\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:38:53.684259 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.684224 2578 generic.go:356] "Generic (PLEG): container finished" podID="abce0723-1104-43b3-9cc9-f8d1252e2b82" containerID="f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e" exitCode=0 Jul 10 23:38:53.684460 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.684271 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" Jul 10 23:38:53.684460 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.684303 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" event={"ID":"abce0723-1104-43b3-9cc9-f8d1252e2b82","Type":"ContainerDied","Data":"f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e"} Jul 10 23:38:53.684460 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.684350 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm" event={"ID":"abce0723-1104-43b3-9cc9-f8d1252e2b82","Type":"ContainerDied","Data":"38e823cad0759df7943660c4e6542a75dce57549525e99c7762ef263ac2d8b22"} Jul 10 23:38:53.684460 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.684367 2578 scope.go:117] "RemoveContainer" containerID="f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e" Jul 10 23:38:53.695896 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.695867 2578 scope.go:117] "RemoveContainer" containerID="f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e" Jul 10 23:38:53.696428 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:38:53.696397 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e\": container with ID starting with f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e not found: ID does not exist" containerID="f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e" Jul 10 23:38:53.696536 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.696441 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e"} err="failed to get container status \"f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e\": rpc error: code = NotFound desc = could not find container \"f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e\": container with ID starting with f6cc5ccd3f6a2983517b1a808ec5bf15143bb3ea0bb322eecfdac3fcaa980a0e not found: ID does not exist" Jul 10 23:38:53.706090 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.706056 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm"] Jul 10 23:38:53.711799 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.711766 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/sub-test-model-f5848c-kserve-5b9fc478d7-l2rnm"] Jul 10 23:38:53.948997 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:38:53.948914 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abce0723-1104-43b3-9cc9-f8d1252e2b82" path="/var/lib/kubelet/pods/abce0723-1104-43b3-9cc9-f8d1252e2b82/volumes" Jul 10 23:39:16.520427 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:16.520342 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:39:31.510103 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:31.510061 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:39:50.115476 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:50.115441 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:39:57.207927 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.207896 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7459-140572291844656"] Jul 10 23:39:57.208323 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.208225 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abce0723-1104-43b3-9cc9-f8d1252e2b82" containerName="main" Jul 10 23:39:57.208323 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.208236 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abce0723-1104-43b3-9cc9-f8d1252e2b82" containerName="main" Jul 10 23:39:57.208323 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.208309 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="abce0723-1104-43b3-9cc9-f8d1252e2b82" containerName="main" Jul 10 23:39:57.211066 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.211048 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291844656" Jul 10 23:39:57.213122 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.213100 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xdkqz\"" Jul 10 23:39:57.217585 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.217506 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291844656"] Jul 10 23:39:57.348453 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.348410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdkr\" (UniqueName: \"kubernetes.io/projected/f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc-kube-api-access-mmdkr\") pod \"test-curl-7459-140572291844656\" (UID: \"f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc\") " pod="openshift-ingress/test-curl-7459-140572291844656" Jul 10 23:39:57.449791 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.449756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdkr\" (UniqueName: \"kubernetes.io/projected/f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc-kube-api-access-mmdkr\") pod \"test-curl-7459-140572291844656\" (UID: \"f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc\") " pod="openshift-ingress/test-curl-7459-140572291844656" Jul 10 23:39:57.457478 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.457447 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdkr\" (UniqueName: \"kubernetes.io/projected/f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc-kube-api-access-mmdkr\") pod \"test-curl-7459-140572291844656\" (UID: \"f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc\") " pod="openshift-ingress/test-curl-7459-140572291844656" Jul 10 23:39:57.521516 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.521428 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291844656" Jul 10 23:39:57.655554 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.655523 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291844656"] Jul 10 23:39:57.658227 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:39:57.658199 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3230c6a_a574_4bf5_b0d8_be71c1cfd8dc.slice/crio-127347362e65be1472f260a7e5d7bba7fdfdf2a6ae04b8a3a725186abb5a9907 WatchSource:0}: Error finding container 127347362e65be1472f260a7e5d7bba7fdfdf2a6ae04b8a3a725186abb5a9907: Status 404 returned error can't find the container with id 127347362e65be1472f260a7e5d7bba7fdfdf2a6ae04b8a3a725186abb5a9907 Jul 10 23:39:57.659848 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.659825 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 23:39:57.986520 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:57.986483 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291844656" event={"ID":"f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc","Type":"ContainerStarted","Data":"127347362e65be1472f260a7e5d7bba7fdfdf2a6ae04b8a3a725186abb5a9907"} Jul 10 23:39:58.992393 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:58.992360 2578 generic.go:356] "Generic (PLEG): container finished" podID="f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc" containerID="aaf604595db45ced4849e47d58239923f5e4c89b8994a9d03aff9dfc54944f16" exitCode=0 Jul 10 23:39:58.992823 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:39:58.992451 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291844656" event={"ID":"f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc","Type":"ContainerDied","Data":"aaf604595db45ced4849e47d58239923f5e4c89b8994a9d03aff9dfc54944f16"} Jul 10 23:40:00.139616 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.139580 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291844656" Jul 10 23:40:00.170602 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.170576 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7459-140572291844656_f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc/test-curl-7459-140572291844656/0.log" Jul 10 23:40:00.198295 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.198259 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7459-140572291844656"] Jul 10 23:40:00.201956 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.201932 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7459-140572291844656"] Jul 10 23:40:00.272607 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.272520 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmdkr\" (UniqueName: \"kubernetes.io/projected/f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc-kube-api-access-mmdkr\") pod \"f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc\" (UID: \"f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc\") " Jul 10 23:40:00.274973 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.274939 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc-kube-api-access-mmdkr" (OuterVolumeSpecName: "kube-api-access-mmdkr") pod "f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc" (UID: "f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc"). InnerVolumeSpecName "kube-api-access-mmdkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:40:00.319457 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.319418 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7459-140572291838896"] Jul 10 23:40:00.319775 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.319761 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc" containerName="test-curl-7459-140572291844656" Jul 10 23:40:00.319829 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.319778 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc" containerName="test-curl-7459-140572291844656" Jul 10 23:40:00.319864 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.319836 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc" containerName="test-curl-7459-140572291844656" Jul 10 23:40:00.322738 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.322698 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291838896" Jul 10 23:40:00.327975 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.327950 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291838896"] Jul 10 23:40:00.373918 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.373877 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmdkr\" (UniqueName: \"kubernetes.io/projected/f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc-kube-api-access-mmdkr\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:40:00.474990 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.474949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r4rt\" (UniqueName: \"kubernetes.io/projected/a66bae17-fba3-4068-a441-5b334a0e804c-kube-api-access-7r4rt\") pod \"test-curl-7459-140572291838896\" (UID: \"a66bae17-fba3-4068-a441-5b334a0e804c\") " pod="openshift-ingress/test-curl-7459-140572291838896" Jul 10 23:40:00.576238 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.576194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r4rt\" (UniqueName: \"kubernetes.io/projected/a66bae17-fba3-4068-a441-5b334a0e804c-kube-api-access-7r4rt\") pod \"test-curl-7459-140572291838896\" (UID: \"a66bae17-fba3-4068-a441-5b334a0e804c\") " pod="openshift-ingress/test-curl-7459-140572291838896" Jul 10 23:40:00.583693 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.583663 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r4rt\" (UniqueName: \"kubernetes.io/projected/a66bae17-fba3-4068-a441-5b334a0e804c-kube-api-access-7r4rt\") pod \"test-curl-7459-140572291838896\" (UID: \"a66bae17-fba3-4068-a441-5b334a0e804c\") " pod="openshift-ingress/test-curl-7459-140572291838896" Jul 10 23:40:00.633776 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.633699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291838896" Jul 10 23:40:00.773729 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:00.773603 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291838896"] Jul 10 23:40:00.782663 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:40:00.782629 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda66bae17_fba3_4068_a441_5b334a0e804c.slice/crio-9bc5e726be3478ec3388b5aeb81aa572859b081089d47d3b8bb6a54b8b1f850e WatchSource:0}: Error finding container 9bc5e726be3478ec3388b5aeb81aa572859b081089d47d3b8bb6a54b8b1f850e: Status 404 returned error can't find the container with id 9bc5e726be3478ec3388b5aeb81aa572859b081089d47d3b8bb6a54b8b1f850e Jul 10 23:40:01.003700 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:01.003613 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291844656" Jul 10 23:40:01.003880 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:01.003618 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="127347362e65be1472f260a7e5d7bba7fdfdf2a6ae04b8a3a725186abb5a9907" Jul 10 23:40:01.004881 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:01.004855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291838896" event={"ID":"a66bae17-fba3-4068-a441-5b334a0e804c","Type":"ContainerStarted","Data":"9bc5e726be3478ec3388b5aeb81aa572859b081089d47d3b8bb6a54b8b1f850e"} Jul 10 23:40:01.013916 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:40:01.013887 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7459-140572291844656\" is forbidden: User \"system:node:ip-10-0-135-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-146.ec2.internal' and this object" podUID="f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc" pod="openshift-ingress/test-curl-7459-140572291844656" Jul 10 23:40:01.948138 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:01.948100 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc" path="/var/lib/kubelet/pods/f3230c6a-a574-4bf5-b0d8-be71c1cfd8dc/volumes" Jul 10 23:40:02.011220 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:02.011186 2578 generic.go:356] "Generic (PLEG): container finished" podID="a66bae17-fba3-4068-a441-5b334a0e804c" containerID="63ef8bbb41dba34ba69df7840f7a735e85018d722c13af0e5d5e90385af31fdb" exitCode=0 Jul 10 23:40:02.011388 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:02.011267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291838896" event={"ID":"a66bae17-fba3-4068-a441-5b334a0e804c","Type":"ContainerDied","Data":"63ef8bbb41dba34ba69df7840f7a735e85018d722c13af0e5d5e90385af31fdb"} Jul 10 23:40:03.160551 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.160525 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291838896" Jul 10 23:40:03.179430 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.179401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7459-140572291838896_a66bae17-fba3-4068-a441-5b334a0e804c/test-curl-7459-140572291838896/0.log" Jul 10 23:40:03.204508 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.204475 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7459-140572291838896"] Jul 10 23:40:03.206290 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.206264 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7459-140572291838896"] Jul 10 23:40:03.300012 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.299979 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r4rt\" (UniqueName: \"kubernetes.io/projected/a66bae17-fba3-4068-a441-5b334a0e804c-kube-api-access-7r4rt\") pod \"a66bae17-fba3-4068-a441-5b334a0e804c\" (UID: \"a66bae17-fba3-4068-a441-5b334a0e804c\") " Jul 10 23:40:03.302219 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.302189 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66bae17-fba3-4068-a441-5b334a0e804c-kube-api-access-7r4rt" (OuterVolumeSpecName: "kube-api-access-7r4rt") pod "a66bae17-fba3-4068-a441-5b334a0e804c" (UID: "a66bae17-fba3-4068-a441-5b334a0e804c"). InnerVolumeSpecName "kube-api-access-7r4rt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:40:03.389490 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.389453 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:03.389813 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.389799 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66bae17-fba3-4068-a441-5b334a0e804c" containerName="test-curl-7459-140572291838896" Jul 10 23:40:03.389860 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.389815 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66bae17-fba3-4068-a441-5b334a0e804c" containerName="test-curl-7459-140572291838896" Jul 10 23:40:03.389894 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.389867 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66bae17-fba3-4068-a441-5b334a0e804c" containerName="test-curl-7459-140572291838896" Jul 10 23:40:03.392743 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.392726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:03.398135 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.398110 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:03.400597 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.400576 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r4rt\" (UniqueName: \"kubernetes.io/projected/a66bae17-fba3-4068-a441-5b334a0e804c-kube-api-access-7r4rt\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:40:03.501154 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.501114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x265w\" (UniqueName: \"kubernetes.io/projected/a0f17743-1167-42c1-af14-6d76a9c5b199-kube-api-access-x265w\") pod \"test-curl-7459-140572291837360\" (UID: \"a0f17743-1167-42c1-af14-6d76a9c5b199\") " pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:03.602157 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.602069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x265w\" (UniqueName: \"kubernetes.io/projected/a0f17743-1167-42c1-af14-6d76a9c5b199-kube-api-access-x265w\") pod \"test-curl-7459-140572291837360\" (UID: \"a0f17743-1167-42c1-af14-6d76a9c5b199\") " pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:03.611141 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.611104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x265w\" (UniqueName: \"kubernetes.io/projected/a0f17743-1167-42c1-af14-6d76a9c5b199-kube-api-access-x265w\") pod \"test-curl-7459-140572291837360\" (UID: \"a0f17743-1167-42c1-af14-6d76a9c5b199\") " pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:03.702164 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.702133 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:03.838183 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.838157 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:03.840331 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:40:03.840291 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0f17743_1167_42c1_af14_6d76a9c5b199.slice/crio-3a1c8b1015809ad1f71ec1aa46e54d032a77ffabae61245a8b18667eb4a3459d WatchSource:0}: Error finding container 3a1c8b1015809ad1f71ec1aa46e54d032a77ffabae61245a8b18667eb4a3459d: Status 404 returned error can't find the container with id 3a1c8b1015809ad1f71ec1aa46e54d032a77ffabae61245a8b18667eb4a3459d Jul 10 23:40:03.947585 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:03.947545 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a66bae17-fba3-4068-a441-5b334a0e804c" path="/var/lib/kubelet/pods/a66bae17-fba3-4068-a441-5b334a0e804c/volumes" Jul 10 23:40:04.022757 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:04.022698 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291837360" event={"ID":"a0f17743-1167-42c1-af14-6d76a9c5b199","Type":"ContainerStarted","Data":"3a1c8b1015809ad1f71ec1aa46e54d032a77ffabae61245a8b18667eb4a3459d"} Jul 10 23:40:04.023962 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:04.023946 2578 scope.go:117] "RemoveContainer" containerID="63ef8bbb41dba34ba69df7840f7a735e85018d722c13af0e5d5e90385af31fdb" Jul 10 23:40:04.024079 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:04.023969 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291838896" Jul 10 23:40:05.030995 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:05.030952 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0f17743-1167-42c1-af14-6d76a9c5b199" containerID="9e14888a965c16e417a2e31af5eea34cd203921cf0a1755b61269be4ea97b246" exitCode=0 Jul 10 23:40:05.031459 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:05.031024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291837360" event={"ID":"a0f17743-1167-42c1-af14-6d76a9c5b199","Type":"ContainerDied","Data":"9e14888a965c16e417a2e31af5eea34cd203921cf0a1755b61269be4ea97b246"} Jul 10 23:40:06.187318 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.187288 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:06.207201 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.207174 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7459-140572291837360_a0f17743-1167-42c1-af14-6d76a9c5b199/test-curl-7459-140572291837360/0.log" Jul 10 23:40:06.232064 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.232029 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:06.236193 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.236164 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:06.325851 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.325814 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x265w\" (UniqueName: \"kubernetes.io/projected/a0f17743-1167-42c1-af14-6d76a9c5b199-kube-api-access-x265w\") pod \"a0f17743-1167-42c1-af14-6d76a9c5b199\" (UID: \"a0f17743-1167-42c1-af14-6d76a9c5b199\") " Jul 10 23:40:06.328205 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.328170 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0f17743-1167-42c1-af14-6d76a9c5b199-kube-api-access-x265w" (OuterVolumeSpecName: "kube-api-access-x265w") pod "a0f17743-1167-42c1-af14-6d76a9c5b199" (UID: "a0f17743-1167-42c1-af14-6d76a9c5b199"). InnerVolumeSpecName "kube-api-access-x265w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:40:06.363327 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.363289 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:06.363661 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.363647 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0f17743-1167-42c1-af14-6d76a9c5b199" containerName="test-curl-7459-140572291837360" Jul 10 23:40:06.363746 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.363663 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0f17743-1167-42c1-af14-6d76a9c5b199" containerName="test-curl-7459-140572291837360" Jul 10 23:40:06.363794 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.363756 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0f17743-1167-42c1-af14-6d76a9c5b199" containerName="test-curl-7459-140572291837360" Jul 10 23:40:06.366636 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.366618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:06.372873 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.372842 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:06.426488 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.426450 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x265w\" (UniqueName: \"kubernetes.io/projected/a0f17743-1167-42c1-af14-6d76a9c5b199-kube-api-access-x265w\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:40:06.527851 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.527809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhc8q\" (UniqueName: \"kubernetes.io/projected/c7cc8732-46ed-411b-9a58-c806326cb036-kube-api-access-rhc8q\") pod \"test-curl-7459-140572291837360\" (UID: \"c7cc8732-46ed-411b-9a58-c806326cb036\") " pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:06.628981 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.628881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhc8q\" (UniqueName: \"kubernetes.io/projected/c7cc8732-46ed-411b-9a58-c806326cb036-kube-api-access-rhc8q\") pod \"test-curl-7459-140572291837360\" (UID: \"c7cc8732-46ed-411b-9a58-c806326cb036\") " pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:06.636812 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.636783 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhc8q\" (UniqueName: \"kubernetes.io/projected/c7cc8732-46ed-411b-9a58-c806326cb036-kube-api-access-rhc8q\") pod \"test-curl-7459-140572291837360\" (UID: \"c7cc8732-46ed-411b-9a58-c806326cb036\") " pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:06.677796 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.677762 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:06.814847 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:06.814819 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:06.817356 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:40:06.817320 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7cc8732_46ed_411b_9a58_c806326cb036.slice/crio-e305c7aee776bed781eb215a10bf7c6642b1c316892cc2d3ca554d290d2458ff WatchSource:0}: Error finding container e305c7aee776bed781eb215a10bf7c6642b1c316892cc2d3ca554d290d2458ff: Status 404 returned error can't find the container with id e305c7aee776bed781eb215a10bf7c6642b1c316892cc2d3ca554d290d2458ff Jul 10 23:40:07.042667 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:07.042643 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:07.042868 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:07.042690 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a1c8b1015809ad1f71ec1aa46e54d032a77ffabae61245a8b18667eb4a3459d" Jul 10 23:40:07.043904 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:07.043876 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291837360" event={"ID":"c7cc8732-46ed-411b-9a58-c806326cb036","Type":"ContainerStarted","Data":"e305c7aee776bed781eb215a10bf7c6642b1c316892cc2d3ca554d290d2458ff"} Jul 10 23:40:07.053952 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:07.053919 2578 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7459-140572291837360" oldPodUID="a0f17743-1167-42c1-af14-6d76a9c5b199" podUID="c7cc8732-46ed-411b-9a58-c806326cb036" Jul 10 23:40:07.947785 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:07.947751 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0f17743-1167-42c1-af14-6d76a9c5b199" path="/var/lib/kubelet/pods/a0f17743-1167-42c1-af14-6d76a9c5b199/volumes" Jul 10 23:40:08.050291 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:08.050254 2578 generic.go:356] "Generic (PLEG): container finished" podID="c7cc8732-46ed-411b-9a58-c806326cb036" containerID="b6e7e92ef29639c3293a9d32778d567819953b93088aeeca0928902663e7fd34" exitCode=0 Jul 10 23:40:08.050291 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:08.050294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291837360" event={"ID":"c7cc8732-46ed-411b-9a58-c806326cb036","Type":"ContainerDied","Data":"b6e7e92ef29639c3293a9d32778d567819953b93088aeeca0928902663e7fd34"} Jul 10 23:40:08.511885 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:08.511847 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:40:09.206292 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.206267 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:09.225103 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.225071 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7459-140572291837360_c7cc8732-46ed-411b-9a58-c806326cb036/test-curl-7459-140572291837360/0.log" Jul 10 23:40:09.250997 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.250958 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:09.254244 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.254216 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7459-140572291837360"] Jul 10 23:40:09.351535 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.351447 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhc8q\" (UniqueName: \"kubernetes.io/projected/c7cc8732-46ed-411b-9a58-c806326cb036-kube-api-access-rhc8q\") pod \"c7cc8732-46ed-411b-9a58-c806326cb036\" (UID: \"c7cc8732-46ed-411b-9a58-c806326cb036\") " Jul 10 23:40:09.353736 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.353695 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7cc8732-46ed-411b-9a58-c806326cb036-kube-api-access-rhc8q" (OuterVolumeSpecName: "kube-api-access-rhc8q") pod "c7cc8732-46ed-411b-9a58-c806326cb036" (UID: "c7cc8732-46ed-411b-9a58-c806326cb036"). InnerVolumeSpecName "kube-api-access-rhc8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:40:09.386463 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.386430 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"] Jul 10 23:40:09.386784 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.386770 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7cc8732-46ed-411b-9a58-c806326cb036" containerName="test-curl-7459-140572291837360" Jul 10 23:40:09.386836 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.386786 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7cc8732-46ed-411b-9a58-c806326cb036" containerName="test-curl-7459-140572291837360" Jul 10 23:40:09.386870 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.386849 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7cc8732-46ed-411b-9a58-c806326cb036" containerName="test-curl-7459-140572291837360" Jul 10 23:40:09.389747 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.389727 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291584480" Jul 10 23:40:09.395941 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.395914 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"] Jul 10 23:40:09.452504 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.452463 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhc8q\" (UniqueName: \"kubernetes.io/projected/c7cc8732-46ed-411b-9a58-c806326cb036-kube-api-access-rhc8q\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:40:09.553770 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.553731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6895c\" (UniqueName: \"kubernetes.io/projected/ab44d0c7-e101-4d1b-a0e4-3d3093311261-kube-api-access-6895c\") pod \"test-curl-7459-140572291584480\" (UID: \"ab44d0c7-e101-4d1b-a0e4-3d3093311261\") " pod="openshift-ingress/test-curl-7459-140572291584480" Jul 10 23:40:09.654970 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.654877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6895c\" (UniqueName: \"kubernetes.io/projected/ab44d0c7-e101-4d1b-a0e4-3d3093311261-kube-api-access-6895c\") pod \"test-curl-7459-140572291584480\" (UID: \"ab44d0c7-e101-4d1b-a0e4-3d3093311261\") " pod="openshift-ingress/test-curl-7459-140572291584480" Jul 10 23:40:09.662449 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.662415 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6895c\" (UniqueName: \"kubernetes.io/projected/ab44d0c7-e101-4d1b-a0e4-3d3093311261-kube-api-access-6895c\") pod \"test-curl-7459-140572291584480\" (UID: \"ab44d0c7-e101-4d1b-a0e4-3d3093311261\") " pod="openshift-ingress/test-curl-7459-140572291584480" Jul 10 23:40:09.699985 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.699950 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291584480" Jul 10 23:40:09.836229 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.836196 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"] Jul 10 23:40:09.839397 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:40:09.839368 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab44d0c7_e101_4d1b_a0e4_3d3093311261.slice/crio-a6b2e315f0a7a1d3d81aa562399dccb856b8124ff4a2d6266ff2e415c2ecfec7 WatchSource:0}: Error finding container a6b2e315f0a7a1d3d81aa562399dccb856b8124ff4a2d6266ff2e415c2ecfec7: Status 404 returned error can't find the container with id a6b2e315f0a7a1d3d81aa562399dccb856b8124ff4a2d6266ff2e415c2ecfec7 Jul 10 23:40:09.948393 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:09.948302 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7cc8732-46ed-411b-9a58-c806326cb036" path="/var/lib/kubelet/pods/c7cc8732-46ed-411b-9a58-c806326cb036/volumes" Jul 10 23:40:10.061679 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:10.061646 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291584480" event={"ID":"ab44d0c7-e101-4d1b-a0e4-3d3093311261","Type":"ContainerStarted","Data":"a6b2e315f0a7a1d3d81aa562399dccb856b8124ff4a2d6266ff2e415c2ecfec7"} Jul 10 23:40:10.063049 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:10.063024 2578 scope.go:117] "RemoveContainer" containerID="b6e7e92ef29639c3293a9d32778d567819953b93088aeeca0928902663e7fd34" Jul 10 23:40:10.063169 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:10.063035 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291837360" Jul 10 23:40:11.071494 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:11.071455 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab44d0c7-e101-4d1b-a0e4-3d3093311261" containerID="b3e6d6597b000cd58860364fe3824ed39723542fb803a923038597e705bb649c" exitCode=0 Jul 10 23:40:11.071932 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:11.071539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291584480" event={"ID":"ab44d0c7-e101-4d1b-a0e4-3d3093311261","Type":"ContainerDied","Data":"b3e6d6597b000cd58860364fe3824ed39723542fb803a923038597e705bb649c"} Jul 10 23:40:12.226309 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:12.226275 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291584480" Jul 10 23:40:12.244772 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:12.244743 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7459-140572291584480_ab44d0c7-e101-4d1b-a0e4-3d3093311261/test-curl-7459-140572291584480/0.log" Jul 10 23:40:12.269033 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:12.268998 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"] Jul 10 23:40:12.272263 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:12.272232 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"] Jul 10 23:40:12.378996 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:12.378894 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6895c\" (UniqueName: \"kubernetes.io/projected/ab44d0c7-e101-4d1b-a0e4-3d3093311261-kube-api-access-6895c\") pod \"ab44d0c7-e101-4d1b-a0e4-3d3093311261\" (UID: \"ab44d0c7-e101-4d1b-a0e4-3d3093311261\") " Jul 10 23:40:12.381213 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:12.381188 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab44d0c7-e101-4d1b-a0e4-3d3093311261-kube-api-access-6895c" (OuterVolumeSpecName: "kube-api-access-6895c") pod "ab44d0c7-e101-4d1b-a0e4-3d3093311261" (UID: "ab44d0c7-e101-4d1b-a0e4-3d3093311261"). InnerVolumeSpecName "kube-api-access-6895c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 23:40:12.479897 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:12.479859 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6895c\" (UniqueName: \"kubernetes.io/projected/ab44d0c7-e101-4d1b-a0e4-3d3093311261-kube-api-access-6895c\") on node \"ip-10-0-135-146.ec2.internal\" DevicePath \"\"" Jul 10 23:40:13.082211 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:13.082182 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291584480" Jul 10 23:40:13.082393 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:13.082221 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6b2e315f0a7a1d3d81aa562399dccb856b8124ff4a2d6266ff2e415c2ecfec7" Jul 10 23:40:13.091981 ip-10-0-135-146 kubenswrapper[2578]: E0710 23:40:13.091943 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7459-140572291584480\" is forbidden: User \"system:node:ip-10-0-135-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-146.ec2.internal' and this object" podUID="ab44d0c7-e101-4d1b-a0e4-3d3093311261" pod="openshift-ingress/test-curl-7459-140572291584480" Jul 10 23:40:13.951492 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:13.951459 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab44d0c7-e101-4d1b-a0e4-3d3093311261" path="/var/lib/kubelet/pods/ab44d0c7-e101-4d1b-a0e4-3d3093311261/volumes" Jul 10 23:40:19.920316 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:19.920272 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:40:32.315026 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:32.314987 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v9qfz"] Jul 10 23:40:35.164744 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:35.164695 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58bf55498c-xmn86_906ab0f4-04ab-41e2-97d3-437fd1c36227/copy-manifests/0.log" Jul 10 23:40:35.186036 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:35.185989 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58bf55498c-xmn86_906ab0f4-04ab-41e2-97d3-437fd1c36227/manager/0.log" Jul 10 23:40:37.806700 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:37.806626 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-v9qfz_640a031b-a121-47b9-96ca-1e2222c672da/limitador/0.log" Jul 10 23:40:38.423348 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:38.423312 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s5n8z_2da68992-da71-4c7e-8d1f-75836a26404c/discovery/0.log" Jul 10 23:40:39.178505 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:39.178478 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b45fff4d-5hvx9_72b247f6-05e7-4e7c-bcdd-1651a57e9123/router/0.log" Jul 10 23:40:39.782392 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:39.782364 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7cmhp_7080f7e7-1ca0-46fa-83d9-2a84e13482fd/main/0.log" Jul 10 23:40:40.134825 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:40.134781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-5ww2q_98658394-0b89-41fd-aeb6-fb7e0ca8ee4d/main/0.log" Jul 10 23:40:46.072671 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:46.072643 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:40:46.079794 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:46.079766 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:40:46.082647 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:46.082622 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:40:46.092449 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:46.092419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:40:47.160038 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:47.160005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7zvwb_dabca611-e058-4d83-9c92-020a594e5d88/global-pull-secret-syncer/0.log" Jul 10 23:40:47.313391 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:47.313353 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mh4v2_137634da-e1b2-4e22-8edd-4c2c7589d04e/konnectivity-agent/0.log" Jul 10 23:40:47.339262 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:47.339213 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-146.ec2.internal_4c12fda927766b31b44f06f34ca2f545/haproxy/0.log" Jul 10 23:40:52.834149 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:52.834114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-v9qfz_640a031b-a121-47b9-96ca-1e2222c672da/limitador/0.log" Jul 10 23:40:54.631391 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:54.631353 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-r2hnv_ae4455a2-f444-4114-8a88-f0b48c285581/kube-state-metrics/0.log" Jul 10 23:40:54.653249 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:54.653204 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-r2hnv_ae4455a2-f444-4114-8a88-f0b48c285581/kube-rbac-proxy-main/0.log" Jul 10 23:40:54.676382 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:54.676349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-r2hnv_ae4455a2-f444-4114-8a88-f0b48c285581/kube-rbac-proxy-self/0.log" Jul 10 23:40:54.702254 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:54.702220 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-555c8b88f4-qjz69_5a4e1191-a2e1-4f7b-9364-ca75cdbeb613/metrics-server/0.log" Jul 10 23:40:54.727680 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:54.727650 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-bxs7v_d1d63684-7ec4-4e75-bfd6-2a1a22ace2f4/monitoring-plugin/0.log" Jul 10 23:40:54.833203 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:54.833172 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h2rrd_541e83b3-908d-4c67-a918-ef638dd8721c/node-exporter/0.log" Jul 10 23:40:54.853869 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:54.853792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h2rrd_541e83b3-908d-4c67-a918-ef638dd8721c/kube-rbac-proxy/0.log" Jul 10 23:40:54.885989 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:54.885911 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h2rrd_541e83b3-908d-4c67-a918-ef638dd8721c/init-textfile/0.log" Jul 10 23:40:55.005242 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:55.005202 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qmfn6_523195ea-1d1a-43f4-b54e-f6801d549317/kube-rbac-proxy-main/0.log" Jul 10 23:40:55.029429 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:55.029403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qmfn6_523195ea-1d1a-43f4-b54e-f6801d549317/kube-rbac-proxy-self/0.log" Jul 10 23:40:55.048556 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:55.048529 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qmfn6_523195ea-1d1a-43f4-b54e-f6801d549317/openshift-state-metrics/0.log" Jul 10 23:40:55.255195 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:55.255117 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-g7v8n_79eca085-5bb7-45cc-83d5-89bc84b0aeed/prometheus-operator/0.log" Jul 10 23:40:55.270360 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:55.270320 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-g7v8n_79eca085-5bb7-45cc-83d5-89bc84b0aeed/kube-rbac-proxy/0.log" Jul 10 23:40:55.294498 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:55.294463 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-82lvc_d82835c8-fef3-450c-8e82-3e990e704b73/prometheus-operator-admission-webhook/0.log" Jul 10 23:40:57.555229 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:57.555179 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/1.log" Jul 10 23:40:57.562747 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:57.562702 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-n6ntz_7a275f51-6e4c-4ae1-927f-34d9a3896bb6/console-operator/2.log" Jul 10 23:40:58.272531 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.272496 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn"] Jul 10 23:40:58.272887 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.272871 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab44d0c7-e101-4d1b-a0e4-3d3093311261" containerName="test-curl-7459-140572291584480" Jul 10 23:40:58.272887 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.272888 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab44d0c7-e101-4d1b-a0e4-3d3093311261" containerName="test-curl-7459-140572291584480" Jul 10 23:40:58.272982 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.272946 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab44d0c7-e101-4d1b-a0e4-3d3093311261" containerName="test-curl-7459-140572291584480" Jul 10 23:40:58.275994 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.275966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.278325 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.278293 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjdll\"/\"kube-root-ca.crt\"" Jul 10 23:40:58.278994 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.278973 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pjdll\"/\"default-dockercfg-8j987\"" Jul 10 23:40:58.278994 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.278984 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjdll\"/\"openshift-service-ca.crt\"" Jul 10 23:40:58.284078 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.284014 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn"] Jul 10 23:40:58.393085 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.393049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-lib-modules\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.393085 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.393093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-podres\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.393300 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.393126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-proc\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.393300 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.393148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-sys\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.393300 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.393165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn2tl\" (UniqueName: \"kubernetes.io/projected/eb8a16de-741e-4f36-ae61-b9619bb275e0-kube-api-access-cn2tl\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.494517 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.494473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-lib-modules\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.494517 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.494517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-podres\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.494819 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.494545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-proc\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.494819 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.494567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-sys\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.494819 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.494632 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-sys\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.494819 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.494636 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-proc\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.494819 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.494645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn2tl\" (UniqueName: \"kubernetes.io/projected/eb8a16de-741e-4f36-ae61-b9619bb275e0-kube-api-access-cn2tl\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.494819 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.494653 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-lib-modules\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.494819 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.494658 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb8a16de-741e-4f36-ae61-b9619bb275e0-podres\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.501968 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.501935 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn2tl\" (UniqueName: \"kubernetes.io/projected/eb8a16de-741e-4f36-ae61-b9619bb275e0-kube-api-access-cn2tl\") pod \"perf-node-gather-daemonset-9m9qn\" (UID: \"eb8a16de-741e-4f36-ae61-b9619bb275e0\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.587095 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.587060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:58.730364 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:58.730339 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn"] Jul 10 23:40:58.732654 ip-10-0-135-146 kubenswrapper[2578]: W0710 23:40:58.732621 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeb8a16de_741e_4f36_ae61_b9619bb275e0.slice/crio-895bf3b51c54d56cba6bb52e86e58f4ae9e6f85a65ef24c9ed820397a17bd12a WatchSource:0}: Error finding container 895bf3b51c54d56cba6bb52e86e58f4ae9e6f85a65ef24c9ed820397a17bd12a: Status 404 returned error can't find the container with id 895bf3b51c54d56cba6bb52e86e58f4ae9e6f85a65ef24c9ed820397a17bd12a Jul 10 23:40:59.301725 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:59.301679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" event={"ID":"eb8a16de-741e-4f36-ae61-b9619bb275e0","Type":"ContainerStarted","Data":"6ad60666de7def748bee988bd7a3437dbc3ad8c1a80c55c28ef49baf1f7811e7"} Jul 10 23:40:59.301909 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:59.301758 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" event={"ID":"eb8a16de-741e-4f36-ae61-b9619bb275e0","Type":"ContainerStarted","Data":"895bf3b51c54d56cba6bb52e86e58f4ae9e6f85a65ef24c9ed820397a17bd12a"} Jul 10 23:40:59.301909 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:59.301798 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:40:59.317136 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:59.317073 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" podStartSLOduration=1.317054978 podStartE2EDuration="1.317054978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 23:40:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:40:59.31553271 +0000 UTC m=+2713.811965602" watchObservedRunningTime="2026-07-10 23:40:59.317054978 +0000 UTC m=+2713.813487858" Jul 10 23:40:59.887529 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:59.887478 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pjgcr_23e16f1d-18fe-4093-a939-acb9948155f3/dns/0.log" Jul 10 23:40:59.906621 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:59.906575 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pjgcr_23e16f1d-18fe-4093-a939-acb9948155f3/kube-rbac-proxy/0.log" Jul 10 23:40:59.989155 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:40:59.989124 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jg9xc_76386443-600f-4203-9262-9d5b3465cb66/dns-node-resolver/0.log" Jul 10 23:41:00.564685 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:00.564649 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s56qh_54b04330-58f8-4df4-9ba2-79950539353f/node-ca/0.log" Jul 10 23:41:01.674362 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:01.674329 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s5n8z_2da68992-da71-4c7e-8d1f-75836a26404c/discovery/0.log" Jul 10 23:41:01.893433 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:01.893398 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b45fff4d-5hvx9_72b247f6-05e7-4e7c-bcdd-1651a57e9123/router/0.log" Jul 10 23:41:02.572562 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:02.572518 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7fbsp_13c5e442-70d0-45ff-b81a-53dd2bc14b98/serve-healthcheck-canary/0.log" Jul 10 23:41:03.193298 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:03.193267 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cqcnb_e78c7477-0287-4dc0-a489-f3c482fe328d/kube-rbac-proxy/0.log" Jul 10 23:41:03.211791 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:03.211761 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cqcnb_e78c7477-0287-4dc0-a489-f3c482fe328d/exporter/0.log" Jul 10 23:41:03.231615 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:03.231579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cqcnb_e78c7477-0287-4dc0-a489-f3c482fe328d/extractor/0.log" Jul 10 23:41:05.317235 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:05.317206 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-9m9qn" Jul 10 23:41:05.863807 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:05.863759 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58bf55498c-xmn86_906ab0f4-04ab-41e2-97d3-437fd1c36227/manager/0.log" Jul 10 23:41:05.879552 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:05.879525 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58bf55498c-xmn86_906ab0f4-04ab-41e2-97d3-437fd1c36227/copy-manifests/0.log" Jul 10 23:41:07.107093 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:07.107060 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85bcb67fdb-wj5x2_a53dcb55-a7ed-412c-a9a7-17a3a216a9c0/manager/0.log" Jul 10 23:41:08.898420 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:08.898389 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s5n8z_2da68992-da71-4c7e-8d1f-75836a26404c/discovery/0.log" Jul 10 23:41:09.019363 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:09.019333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b45fff4d-5hvx9_72b247f6-05e7-4e7c-bcdd-1651a57e9123/router/0.log" Jul 10 23:41:10.531014 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:10.530893 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s5n8z_2da68992-da71-4c7e-8d1f-75836a26404c/discovery/0.log" Jul 10 23:41:10.672464 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:10.672431 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59b45fff4d-5hvx9_72b247f6-05e7-4e7c-bcdd-1651a57e9123/router/0.log" Jul 10 23:41:13.924080 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:13.924048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8tv_a901a703-a86b-44f3-97a6-2081fda5042d/kube-multus-additional-cni-plugins/0.log" Jul 10 23:41:13.943430 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:13.943399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8tv_a901a703-a86b-44f3-97a6-2081fda5042d/egress-router-binary-copy/0.log" Jul 10 23:41:13.962114 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:13.962064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8tv_a901a703-a86b-44f3-97a6-2081fda5042d/cni-plugins/0.log" Jul 10 23:41:13.981359 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:13.981331 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8tv_a901a703-a86b-44f3-97a6-2081fda5042d/bond-cni-plugin/0.log" Jul 10 23:41:14.000818 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:14.000760 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8tv_a901a703-a86b-44f3-97a6-2081fda5042d/routeoverride-cni/0.log" Jul 10 23:41:14.019344 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:14.019301 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8tv_a901a703-a86b-44f3-97a6-2081fda5042d/whereabouts-cni-bincopy/0.log" Jul 10 23:41:14.037724 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:14.037686 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tw8tv_a901a703-a86b-44f3-97a6-2081fda5042d/whereabouts-cni/0.log" Jul 10 23:41:14.352626 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:14.352588 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lnhpt_88ebfcba-80ce-4fb6-83b5-a4ee524cbef0/kube-multus/0.log" Jul 10 23:41:14.492628 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:14.492601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zktgk_3c7063b8-b242-45ff-a6b2-342d66a4cc64/network-metrics-daemon/0.log" Jul 10 23:41:14.514347 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:14.514315 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zktgk_3c7063b8-b242-45ff-a6b2-342d66a4cc64/kube-rbac-proxy/0.log" Jul 10 23:41:15.373525 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:15.373495 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-controller/0.log" Jul 10 23:41:15.388802 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:15.388773 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/1.log" Jul 10 23:41:15.388995 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:15.388901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovn-acl-logging/0.log" Jul 10 23:41:15.418187 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:15.418155 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/kube-rbac-proxy-node/0.log" Jul 10 23:41:15.443945 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:15.443908 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/kube-rbac-proxy-ovn-metrics/0.log" Jul 10 23:41:15.459023 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:15.458975 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/northd/0.log" Jul 10 23:41:15.476601 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:15.476574 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/nbdb/0.log" Jul 10 23:41:15.494949 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:15.494894 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/sbdb/0.log" Jul 10 23:41:15.571232 ip-10-0-135-146 kubenswrapper[2578]: I0710 23:41:15.571195 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8ldq_6ead4faf-1e4b-4c26-bc9c-62b3067b0352/ovnkube-controller/0.log"