Jul 07 15:29:26.432459 ip-10-0-130-86 systemd[1]: Starting Kubernetes Kubelet... Jul 07 15:29:26.894502 ip-10-0-130-86 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:29:26.894502 ip-10-0-130-86 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 15:29:26.894502 ip-10-0-130-86 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:29:26.894502 ip-10-0-130-86 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 15:29:26.894502 ip-10-0-130-86 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:29:26.895525 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.895435 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 15:29:26.899974 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.899956 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:29:26.899974 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.899974 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.899980 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.899983 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.899986 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.899989 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.899992 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.899994 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.899999 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900003 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900006 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900010 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900014 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900017 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900020 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900022 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900025 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900033 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:29:26.900031 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900037 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900040 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900043 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900045 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900048 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900050 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900053 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900055 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900058 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900060 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900063 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900065 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900070 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900072 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900074 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900077 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900079 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900082 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900084 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900087 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:29:26.900495 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900090 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900092 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900095 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900097 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900099 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900101 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900104 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900106 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900108 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900111 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900113 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900128 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900131 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900134 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900139 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900142 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900144 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900147 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900149 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900152 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:29:26.901183 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900154 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900157 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900159 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900161 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900164 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900166 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900169 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900172 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900174 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900177 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900180 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900182 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900185 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900188 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900190 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900192 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900195 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900198 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900200 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900202 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:29:26.901822 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900205 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900207 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900211 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900214 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900216 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900218 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900222 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900224 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900227 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900230 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900232 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900235 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900237 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900240 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900242 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900244 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900247 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900249 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900251 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900254 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:29:26.902321 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.900256 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902216 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902227 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902231 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902234 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902237 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902241 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902243 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902246 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902250 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902253 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902255 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902258 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902261 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902263 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902266 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902269 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902271 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902274 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:29:26.902797 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902276 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902278 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902283 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902286 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902289 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902292 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902294 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902296 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902299 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902302 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902304 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902306 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902309 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902311 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902314 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902317 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902321 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902326 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902329 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:29:26.903312 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902332 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902335 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902337 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902340 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902342 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902345 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902347 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902350 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902352 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902355 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902357 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902360 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902362 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902365 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902367 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902369 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902372 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902374 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902376 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902379 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:29:26.903782 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902381 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902383 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902386 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902388 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902391 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902393 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902396 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902400 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902404 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902407 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902410 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902412 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902415 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902417 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902419 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902426 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902429 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902431 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902434 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902437 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:29:26.904277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902439 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902442 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902444 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902446 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902449 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902453 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902456 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902458 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902461 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902463 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902466 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902468 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902470 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902473 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902475 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902478 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902480 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902483 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902485 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902487 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:29:26.904760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902493 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902496 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902899 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902904 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902907 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902909 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902912 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902914 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902917 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902919 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902922 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902924 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902927 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902930 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902932 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902935 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902937 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902939 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902942 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902945 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:29:26.905281 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902948 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902950 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902953 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902955 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902957 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902960 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902962 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902964 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902968 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902972 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902975 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902977 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902982 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902985 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902988 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902990 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902993 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902996 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.902998 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:29:26.905759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903001 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903003 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903005 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903008 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903010 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903014 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903017 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903020 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903022 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903024 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903027 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903029 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903032 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903035 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903037 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903040 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903042 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903044 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903047 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:29:26.906243 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903049 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903052 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903054 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903056 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903059 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903061 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903065 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903068 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903070 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903073 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903075 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903078 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903080 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903083 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903085 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903087 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903090 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903092 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903095 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903097 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:29:26.906704 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903099 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903102 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903105 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903108 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903110 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903113 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903134 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903137 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903140 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903143 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903145 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903147 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903150 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903152 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903154 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903158 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903161 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903164 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903169 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903172 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:29:26.907196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903175 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903177 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903180 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903253 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903260 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903266 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903270 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903275 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903277 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903282 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903286 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903289 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903292 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903295 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903298 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903301 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903304 2561 flags.go:64] FLAG: --cgroup-root="" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903307 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903310 2561 flags.go:64] FLAG: --client-ca-file="" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903313 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903316 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903321 2561 flags.go:64] FLAG: --cluster-domain="" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903324 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903327 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 15:29:26.907678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903330 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903333 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903336 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903339 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903342 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903345 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903349 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903351 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903354 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903357 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903360 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903364 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903367 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903370 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903372 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903375 2561 flags.go:64] FLAG: --enable-server="true" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903378 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903382 2561 flags.go:64] FLAG: --event-burst="100" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903385 2561 flags.go:64] FLAG: --event-qps="50" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903387 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903390 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903392 2561 flags.go:64] FLAG: --eviction-hard="" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903396 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903399 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903401 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 15:29:26.908259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903404 2561 flags.go:64] FLAG: --eviction-soft="" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903407 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903409 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903412 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903416 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903419 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903421 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903424 2561 flags.go:64] FLAG: --feature-gates="" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903428 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903430 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903433 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903436 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903439 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903442 2561 flags.go:64] FLAG: --help="false" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903445 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-130-86.ec2.internal" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903448 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903451 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903453 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903457 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903460 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903462 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903465 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903468 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 15:29:26.908882 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903470 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903473 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903476 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903478 2561 flags.go:64] FLAG: --kube-reserved="" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903481 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903484 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903487 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903489 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903492 2561 flags.go:64] FLAG: --lock-file="" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903495 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903497 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903500 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903505 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903510 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903513 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903515 2561 flags.go:64] FLAG: --logging-format="text" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903518 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903521 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903524 2561 flags.go:64] FLAG: --manifest-url="" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903526 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903531 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903534 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903538 2561 flags.go:64] FLAG: --max-pods="110" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903541 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903544 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 15:29:26.909500 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903546 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903549 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903552 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903554 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903557 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903567 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903570 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903573 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903575 2561 flags.go:64] FLAG: --pod-cidr="" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903578 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903584 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903587 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903590 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903592 2561 flags.go:64] FLAG: --port="10250" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903595 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903598 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e9099085959dba7" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903601 2561 flags.go:64] FLAG: --qos-reserved="" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903603 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903606 2561 flags.go:64] FLAG: --register-node="true" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903609 2561 flags.go:64] FLAG: --register-with-taints="" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903613 2561 flags.go:64] FLAG: --registry-burst="10" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903616 2561 flags.go:64] FLAG: --registry-qps="5" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903619 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903622 2561 flags.go:64] FLAG: --reserved-memory="" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903625 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 15:29:26.910114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903628 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903631 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903634 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903636 2561 flags.go:64] FLAG: --runonce="false" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903639 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903642 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903644 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903647 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903650 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903652 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903655 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903658 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903660 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903663 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903665 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903668 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903670 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903673 2561 flags.go:64] FLAG: --system-cgroups="" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903676 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903681 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903683 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903686 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903689 2561 flags.go:64] FLAG: --tls-min-version="" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903691 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903694 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 15:29:26.910746 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903696 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903699 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903703 2561 flags.go:64] FLAG: --v="2" Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903707 2561 flags.go:64] FLAG: --version="false" Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903711 2561 flags.go:64] FLAG: --vmodule="" Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903715 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.903718 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903855 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903859 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903862 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903864 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903867 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903871 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903874 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903876 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903879 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903881 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903884 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903886 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903888 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903891 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:29:26.911366 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903894 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903896 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903899 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903901 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903903 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903906 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903908 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903911 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903913 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903915 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903918 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903920 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903923 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903926 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903929 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903931 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903934 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903936 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903939 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903941 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:29:26.911881 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903943 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903946 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903948 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903952 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903955 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903957 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903960 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903962 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903965 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903967 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903970 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903972 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903974 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903977 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903979 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903982 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903984 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903986 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903989 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903991 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:29:26.912442 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903994 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903996 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.903998 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904001 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904004 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904007 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904010 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904012 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904016 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904020 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904022 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904025 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904028 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904030 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904033 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904037 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904040 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904042 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904045 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:29:26.912941 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904048 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904051 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904053 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904056 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904059 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904061 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904064 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904068 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904071 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904074 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904076 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904078 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904081 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904085 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904088 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904091 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904094 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904096 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:29:26.913461 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904100 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904103 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904105 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904108 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904110 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904113 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904129 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.904132 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.904825 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.911802 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.911819 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.911840 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.911846 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911905 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911910 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:29:26.913903 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911914 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911917 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911920 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911924 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911928 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911931 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911934 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911937 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911940 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911943 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911945 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911948 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911951 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911953 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911956 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911958 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911961 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911963 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911966 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:29:26.914285 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911968 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911971 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911973 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911976 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911980 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911983 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911987 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911990 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911993 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911996 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.911999 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912001 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912004 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912006 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912009 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912011 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912014 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912016 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912019 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912021 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:29:26.914750 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912024 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912027 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912029 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912032 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912035 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912037 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912039 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912042 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912044 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912047 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912049 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912051 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912054 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912056 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912059 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912061 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912066 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912070 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912073 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:29:26.915244 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912076 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912078 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912081 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912083 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912086 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912088 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912091 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912093 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912096 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912098 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912100 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912103 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912105 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912107 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912110 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912112 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912128 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912131 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912133 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912136 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:29:26.915699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912138 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912141 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912143 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912145 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912148 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912151 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912154 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912156 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912159 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912161 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912165 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912168 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912171 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912174 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912177 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912179 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912182 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912184 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:29:26.916350 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912187 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.912192 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912325 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912330 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912333 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912336 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912338 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912340 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912343 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912346 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912348 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912350 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912352 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912355 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912357 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:29:26.916791 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912360 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912362 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912365 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912367 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912371 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912373 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912375 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912378 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912380 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912383 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912386 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912390 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912395 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912397 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912400 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912402 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912405 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912407 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912409 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912412 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:29:26.917186 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912414 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912417 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912419 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912422 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912424 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912427 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912429 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912432 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912434 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912437 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912439 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912442 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912444 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912446 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912450 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912454 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912457 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912460 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912463 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912466 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:29:26.917667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912469 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912471 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912474 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912478 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912480 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912483 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912485 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912488 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912490 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912493 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912495 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912498 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912500 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912502 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912505 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912507 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912509 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912512 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912514 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912517 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:29:26.918161 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912519 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912522 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912524 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912526 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912529 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912531 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912534 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912536 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912540 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912543 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912546 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912549 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912552 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912575 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912578 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912581 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912585 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912588 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912591 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:29:26.918667 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912593 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:29:26.919132 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912596 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:29:26.919132 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912598 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:29:26.919132 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912601 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:29:26.919132 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912603 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:29:26.919132 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912606 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:29:26.919132 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:26.912608 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:29:26.919132 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.912612 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:29:26.919132 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.912750 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 15:29:26.919132 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.918369 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 15:29:26.920595 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.920581 2561 server.go:1019] "Starting client certificate rotation" Jul 07 15:29:26.920709 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.920690 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:29:26.920738 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.920725 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:29:26.923685 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.923671 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:29:26.925158 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.925141 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:29:26.938930 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.938903 2561 log.go:25] "Validated CRI v1 runtime API" Jul 07 15:29:26.942222 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.942205 2561 log.go:25] "Validated CRI v1 image API" Jul 07 15:29:26.943052 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.943029 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 15:29:26.946773 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.946744 2561 fs.go:135] Filesystem UUIDs: map[339f642e-dca1-4c81-a468-37862ddae7c4:/dev/nvme0n1p4 4c76a78e-426d-4f65-9bff-4c3070e2336c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 15:29:26.946843 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.946776 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 15:29:26.952383 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.952254 2561 manager.go:216] Machine: {Timestamp:2026-07-07 15:29:26.950933133 +0000 UTC m=+0.373652359 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100548 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dab6f3425bfde88d744b01a53f13d SystemUUID:ec2dab6f-3425-bfde-88d7-44b01a53f13d BootID:80b0a05f-4e27-48ca-89b7-1e7463d3768b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:40:e9:89:7f:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:40:e9:89:7f:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:8e:f8:3a:77:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 15:29:26.952383 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.952371 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 15:29:26.952529 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.952457 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 15:29:26.956674 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.956639 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 15:29:26.956766 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.956750 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:29:26.956814 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.956676 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 15:29:26.957447 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.957435 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 15:29:26.957480 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.957450 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 15:29:26.957480 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.957458 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:29:26.957480 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.957472 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:29:26.958704 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.958694 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 15:29:26.961862 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.961849 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:29:26.962206 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.962195 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 15:29:26.962240 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.962232 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 07 15:29:26.962285 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.962243 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 15:29:26.962285 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.962262 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 15:29:26.962285 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.962274 2561 kubelet.go:398] "Adding apiserver pod source" Jul 07 15:29:26.962285 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.962286 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 15:29:26.962663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.962652 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:29:26.962706 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.962669 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:29:26.967580 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.967563 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 15:29:26.969837 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.969823 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 15:29:26.969892 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.969855 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 15:29:26.971252 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971240 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 15:29:26.971300 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971257 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 15:29:26.971300 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971270 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 15:29:26.971300 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971275 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 15:29:26.971300 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971284 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 15:29:26.971300 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971289 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 15:29:26.971300 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971297 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 15:29:26.971300 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971303 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 15:29:26.971523 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971310 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 15:29:26.971523 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971315 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 15:29:26.971523 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971330 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 15:29:26.971523 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.971336 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 15:29:26.972825 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.972814 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 15:29:26.972825 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.972825 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 15:29:26.974993 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:26.974958 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 15:29:26.975074 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:26.975045 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 15:29:26.975214 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.975197 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 15:29:26.976060 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.976048 2561 server.go:1268] "Started kubelet" Jul 07 15:29:26.976238 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.976187 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 15:29:26.976315 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.976243 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 15:29:26.976370 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.976257 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 15:29:26.983182 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.980939 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 15:29:26.983182 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:26.982483 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 15:29:26.981255 ip-10-0-130-86 systemd[1]: Started Kubernetes Kubelet. Jul 07 15:29:26.983666 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.983498 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 07 15:29:26.989748 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.989730 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 15:29:26.989748 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.989742 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 15:29:26.989942 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:26.989921 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:26.990482 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.990463 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 15:29:26.990482 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.990482 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 15:29:26.990632 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.990462 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 15:29:26.990632 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.990592 2561 factory.go:55] Registering systemd factory Jul 07 15:29:26.990632 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.990601 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 07 15:29:26.990632 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.990606 2561 factory.go:223] Registration of the systemd container factory successfully Jul 07 15:29:26.990632 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.990610 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 07 15:29:26.991215 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.991196 2561 factory.go:153] Registering CRI-O factory Jul 07 15:29:26.991215 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.991215 2561 factory.go:223] Registration of the crio container factory successfully Jul 07 15:29:26.991366 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.991272 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 15:29:26.991366 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.991294 2561 factory.go:103] Registering Raw factory Jul 07 15:29:26.991366 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.991304 2561 manager.go:1196] Started watching for new ooms in manager Jul 07 15:29:26.991704 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:26.991691 2561 manager.go:349] Starting recovery of all containers Jul 07 15:29:26.996364 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:26.996332 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 15:29:26.996486 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:26.996464 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 15:29:26.997556 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:26.996338 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-86.ec2.internal.18c00b90557abdfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-86.ec2.internal,UID:ip-10-0-130-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-86.ec2.internal,},FirstTimestamp:2026-07-07 15:29:26.976019965 +0000 UTC m=+0.398739190,LastTimestamp:2026-07-07 15:29:26.976019965 +0000 UTC m=+0.398739190,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-86.ec2.internal,}" Jul 07 15:29:27.001477 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.001315 2561 manager.go:354] Recovery completed Jul 07 15:29:27.006453 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.006439 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:29:27.008826 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.008801 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:29:27.008878 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.008839 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:29:27.008878 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.008850 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:29:27.009883 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.009861 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 15:29:27.009883 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.009882 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 15:29:27.010019 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.009897 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:29:27.010019 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.009902 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:29:27.010823 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.010722 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-86.ec2.internal.18c00b90576f53e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-86.ec2.internal,UID:ip-10-0-130-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-86.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-86.ec2.internal,},FirstTimestamp:2026-07-07 15:29:27.008826339 +0000 UTC m=+0.431545563,LastTimestamp:2026-07-07 15:29:27.008826339 +0000 UTC m=+0.431545563,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-86.ec2.internal,}" Jul 07 15:29:27.010977 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.010952 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:29:27.011039 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.010986 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:29:27.011039 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.011005 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:29:27.011808 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.011789 2561 policy_none.go:49] "None policy: Start" Jul 07 15:29:27.011870 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.011820 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 15:29:27.011870 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.011831 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 15:29:27.012841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.012831 2561 policy_none.go:47] "Start" Jul 07 15:29:27.022533 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.022454 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-86.ec2.internal.18c00b90576f992a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-86.ec2.internal,UID:ip-10-0-130-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-86.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-86.ec2.internal,},FirstTimestamp:2026-07-07 15:29:27.008844074 +0000 UTC m=+0.431563299,LastTimestamp:2026-07-07 15:29:27.008844074 +0000 UTC m=+0.431563299,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-86.ec2.internal,}" Jul 07 15:29:27.023170 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.023111 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hst6g" Jul 07 15:29:27.033667 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.033646 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hst6g" Jul 07 15:29:27.034076 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.034008 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-86.ec2.internal.18c00b90576fbd64 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-86.ec2.internal,UID:ip-10-0-130-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-86.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-86.ec2.internal,},FirstTimestamp:2026-07-07 15:29:27.008853348 +0000 UTC m=+0.431572573,LastTimestamp:2026-07-07 15:29:27.008853348 +0000 UTC m=+0.431572573,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-86.ec2.internal,}" Jul 07 15:29:27.049748 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.049714 2561 manager.go:337] "Starting Device Plugin manager" Jul 07 15:29:27.063297 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.049757 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 15:29:27.063297 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.049770 2561 server.go:87] "Starting device plugin registration server" Jul 07 15:29:27.063297 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.050024 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 15:29:27.063297 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.050035 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 15:29:27.063297 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.050157 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 15:29:27.063297 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.050255 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 15:29:27.063297 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.050264 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 15:29:27.063297 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.050790 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 15:29:27.063297 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.050830 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.150256 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.150177 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:29:27.151465 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.151440 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:29:27.151536 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.151490 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:29:27.151536 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.151507 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:29:27.151605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.151545 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.151935 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.151915 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 15:29:27.153310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.153295 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 15:29:27.153379 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.153336 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 15:29:27.153379 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.153368 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 15:29:27.153469 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.153410 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 15:29:27.155745 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.155728 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:29:27.160896 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.160878 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.160964 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.160906 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-86.ec2.internal\": node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.216327 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.216294 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.254409 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.254375 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal"] Jul 07 15:29:27.254490 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.254458 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:29:27.255454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.255440 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:29:27.255517 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.255467 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:29:27.255517 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.255477 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:29:27.256777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.256766 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:29:27.256931 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.256916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.256973 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.256952 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:29:27.257582 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.257567 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:29:27.257659 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.257590 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:29:27.257659 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.257600 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:29:27.258455 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.258435 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:29:27.258535 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.258465 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:29:27.258535 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.258478 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:29:27.259548 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.259531 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.259630 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.259560 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:29:27.260293 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.260275 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:29:27.260355 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.260309 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:29:27.260355 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.260323 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:29:27.283997 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.283965 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-86.ec2.internal\" not found" node="ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.288587 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.288570 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-86.ec2.internal\" not found" node="ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.291776 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.291759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3225c1113471be6cc2c3784a8387dcd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal\" (UID: \"d3225c1113471be6cc2c3784a8387dcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.291841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.291783 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3225c1113471be6cc2c3784a8387dcd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal\" (UID: \"d3225c1113471be6cc2c3784a8387dcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.291841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.291799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de6ff4e436b18660880403245e7c2ccf-config\") pod \"kube-apiserver-proxy-ip-10-0-130-86.ec2.internal\" (UID: \"de6ff4e436b18660880403245e7c2ccf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.316556 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.316520 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.392486 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.392447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3225c1113471be6cc2c3784a8387dcd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal\" (UID: \"d3225c1113471be6cc2c3784a8387dcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.392486 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.392486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3225c1113471be6cc2c3784a8387dcd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal\" (UID: \"d3225c1113471be6cc2c3784a8387dcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.392703 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.392512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de6ff4e436b18660880403245e7c2ccf-config\") pod \"kube-apiserver-proxy-ip-10-0-130-86.ec2.internal\" (UID: \"de6ff4e436b18660880403245e7c2ccf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.392703 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.392549 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3225c1113471be6cc2c3784a8387dcd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal\" (UID: \"d3225c1113471be6cc2c3784a8387dcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.392703 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.392562 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3225c1113471be6cc2c3784a8387dcd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal\" (UID: \"d3225c1113471be6cc2c3784a8387dcd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.392703 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.392558 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/de6ff4e436b18660880403245e7c2ccf-config\") pod \"kube-apiserver-proxy-ip-10-0-130-86.ec2.internal\" (UID: \"de6ff4e436b18660880403245e7c2ccf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.417646 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.417577 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.518438 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.518395 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.587608 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.587584 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.592650 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.592630 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal" Jul 07 15:29:27.618713 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.618682 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.719340 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.719239 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.819806 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.819770 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.920321 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:27.920279 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:27.920321 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.920306 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 15:29:27.920978 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:27.920462 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 15:29:28.021367 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:28.021339 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-86.ec2.internal\" not found" Jul 07 15:29:28.036535 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.036490 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 15:24:27 +0000 UTC" deadline="2027-12-07 02:33:07.085008819 +0000 UTC" Jul 07 15:29:28.036535 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.036523 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12419h3m39.048489234s" Jul 07 15:29:28.083012 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:28.082975 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3225c1113471be6cc2c3784a8387dcd.slice/crio-acb84c18ed3cd6dac69e0fa1d3e8e982adbece53960c555538c804af796d72e3 WatchSource:0}: Error finding container acb84c18ed3cd6dac69e0fa1d3e8e982adbece53960c555538c804af796d72e3: Status 404 returned error can't find the container with id acb84c18ed3cd6dac69e0fa1d3e8e982adbece53960c555538c804af796d72e3 Jul 07 15:29:28.088806 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.088790 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:29:28.099721 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.099690 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:29:28.157132 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.157064 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" event={"ID":"d3225c1113471be6cc2c3784a8387dcd","Type":"ContainerStarted","Data":"acb84c18ed3cd6dac69e0fa1d3e8e982adbece53960c555538c804af796d72e3"} Jul 07 15:29:28.190973 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.190943 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" Jul 07 15:29:28.207403 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.207379 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:29:28.209898 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.209883 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal" Jul 07 15:29:28.220163 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.220148 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:29:28.244262 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.244196 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:29:28.248049 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:28.248020 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6ff4e436b18660880403245e7c2ccf.slice/crio-ac2d094df7e0618df094a0d9e90599d252ada43d60e85e67b74a798865ae1cd8 WatchSource:0}: Error finding container ac2d094df7e0618df094a0d9e90599d252ada43d60e85e67b74a798865ae1cd8: Status 404 returned error can't find the container with id ac2d094df7e0618df094a0d9e90599d252ada43d60e85e67b74a798865ae1cd8 Jul 07 15:29:28.281963 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.281931 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:29:28.964062 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.964022 2561 apiserver.go:52] "Watching apiserver" Jul 07 15:29:28.973205 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.973184 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 15:29:28.973624 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.973600 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-bnnp4","openshift-network-diagnostics/network-check-target-qc9dm","openshift-network-operator/iptables-alerter-254gg","kube-system/global-pull-secret-syncer-xfktn","kube-system/konnectivity-agent-bf5s6","openshift-image-registry/node-ca-bxhl9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal","openshift-multus/multus-2b8zr","openshift-ovn-kubernetes/ovnkube-node-8smmh","kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr","openshift-cluster-node-tuning-operator/tuned-6vjkq","openshift-dns/node-resolver-6bs9m","openshift-multus/multus-additional-cni-plugins-jq5hb"] Jul 07 15:29:28.975537 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.975519 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:28.976678 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.976659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:28.976794 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:28.976738 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:28.977934 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.977916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:28.978396 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.978379 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4tgxt\"" Jul 07 15:29:28.978477 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.978396 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 15:29:28.978770 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.978755 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 15:29:28.979213 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.979176 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:28.979309 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:28.979276 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:28.980502 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.980481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:28.980605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.980518 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 15:29:28.980605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.980529 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:29:28.981033 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.981012 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kfq27\"" Jul 07 15:29:28.981096 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.981073 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 15:29:28.981990 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.981973 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:28.983444 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.983426 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 15:29:28.983444 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.983442 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dlzbq\"" Jul 07 15:29:28.983606 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.983480 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 15:29:28.983606 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.983559 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:28.983712 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:28.983610 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:28.984765 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.984748 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 15:29:28.984857 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.984765 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 15:29:28.984857 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.984792 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 15:29:28.985038 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.985019 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2b8zr" Jul 07 15:29:28.985178 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.985161 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ng8dd\"" Jul 07 15:29:28.986632 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.986618 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:28.988501 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.987983 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 15:29:28.988501 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.988010 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jgg4v\"" Jul 07 15:29:28.988501 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.988082 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 15:29:28.988501 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.988173 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 15:29:28.988501 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.988378 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 15:29:28.988824 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.988556 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:28.990933 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.990341 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 15:29:28.990933 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.990343 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 15:29:28.990933 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.990396 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 15:29:28.990933 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.990593 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 15:29:28.990933 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.990824 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 15:29:28.990933 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.990857 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zm7f5\"" Jul 07 15:29:28.991601 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.991508 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 15:29:28.991601 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.991566 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 15:29:28.992441 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.991952 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5trmm\"" Jul 07 15:29:28.992441 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.992067 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 15:29:28.992441 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.992278 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 15:29:28.992441 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.992372 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:28.995161 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.995142 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 15:29:28.995265 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.995214 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 15:29:28.995467 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.995451 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 15:29:28.995831 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.995796 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mrjbk\"" Jul 07 15:29:28.995934 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.995888 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:28.998385 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.998368 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 15:29:28.998702 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.998511 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:29:28.998702 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:28.998548 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f92x5\"" Jul 07 15:29:29.001515 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001490 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-sys-fs\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.001622 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-system-cni-dir\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.001622 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-var-lib-cni-bin\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.001622 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-conf-dir\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.001622 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-device-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.001622 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56dcv\" (UniqueName: \"kubernetes.io/projected/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-kube-api-access-56dcv\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:29.001622 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-var-lib-kubelet\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.001938 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-cni-netd\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.001938 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-os-release\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.001938 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05ea45eb-026f-49f0-9ebb-f60175c8d22a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.001938 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:29.001938 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.001938 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.001801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8l9r\" (UniqueName: \"kubernetes.io/projected/82446fb3-497f-4c20-9e68-e34b98273d2f-kube-api-access-z8l9r\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.002304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8108322-2c7b-4153-a665-853cabc0ab11-hosts-file\") pod \"node-resolver-6bs9m\" (UID: \"c8108322-2c7b-4153-a665-853cabc0ab11\") " pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.002304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002041 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-cni-dir\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.002304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-var-lib-cni-multus\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.002304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2x8r\" (UniqueName: \"kubernetes.io/projected/f59e9c40-02cd-4132-bbda-7686d4583bd5-kube-api-access-q2x8r\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.002304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002128 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-systemd-units\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.002304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002154 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-cni-bin\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.002304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002179 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-ovn-node-metrics-cert\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.002304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-run-multus-certs\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.002818 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-etc-kubernetes\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.002884 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-log-socket\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.002884 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03c89f85-a9fe-4ac3-beab-8c51f067a9da-kubelet-config\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:29.003024 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002889 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03c89f85-a9fe-4ac3-beab-8c51f067a9da-dbus\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:29.003024 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/151a5f06-a785-4283-861c-1ddf2eea2d55-host\") pod \"node-ca-bxhl9\" (UID: \"151a5f06-a785-4283-861c-1ddf2eea2d55\") " pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.003024 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-run-openvswitch\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003024 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.002956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-socket-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.003024 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003000 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.003294 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-run-ovn\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003294 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-ovnkube-script-lib\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003294 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj9rz\" (UniqueName: \"kubernetes.io/projected/05ea45eb-026f-49f0-9ebb-f60175c8d22a-kube-api-access-hj9rz\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.003294 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003150 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f59e9c40-02cd-4132-bbda-7686d4583bd5-cni-binary-copy\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.003294 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003174 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-socket-dir-parent\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.003294 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-hostroot\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.003294 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-var-lib-openvswitch\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003294 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-ovnkube-config\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003342 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e10241ad-8010-43b1-a4d0-5f855868fab7-konnectivity-ca\") pod \"konnectivity-agent-bf5s6\" (UID: \"e10241ad-8010-43b1-a4d0-5f855868fab7\") " pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-node-log\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6-host-slash\") pod \"iptables-alerter-254gg\" (UID: \"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6\") " pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003468 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-run-netns\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m7pr\" (UniqueName: \"kubernetes.io/projected/c8108322-2c7b-4153-a665-853cabc0ab11-kube-api-access-2m7pr\") pod \"node-resolver-6bs9m\" (UID: \"c8108322-2c7b-4153-a665-853cabc0ab11\") " pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-cnibin\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-run-k8s-cni-cncf-io\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-run-netns\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-kubelet\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-slash\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.003779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8108322-2c7b-4153-a665-853cabc0ab11-tmp-dir\") pod \"node-resolver-6bs9m\" (UID: \"c8108322-2c7b-4153-a665-853cabc0ab11\") " pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-env-overrides\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vplqm\" (UniqueName: \"kubernetes.io/projected/1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6-kube-api-access-vplqm\") pod \"iptables-alerter-254gg\" (UID: \"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6\") " pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003844 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/151a5f06-a785-4283-861c-1ddf2eea2d55-serviceca\") pod \"node-ca-bxhl9\" (UID: \"151a5f06-a785-4283-861c-1ddf2eea2d55\") " pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-os-release\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-run-ovn-kubernetes\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.003947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05ea45eb-026f-49f0-9ebb-f60175c8d22a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004004 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6-iptables-alerter-script\") pod \"iptables-alerter-254gg\" (UID: \"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6\") " pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-daemon-config\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-etc-openvswitch\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2mww\" (UniqueName: \"kubernetes.io/projected/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-kube-api-access-v2mww\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-cnibin\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e10241ad-8010-43b1-a4d0-5f855868fab7-agent-certs\") pod \"konnectivity-agent-bf5s6\" (UID: \"e10241ad-8010-43b1-a4d0-5f855868fab7\") " pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004230 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ckps\" (UniqueName: \"kubernetes.io/projected/151a5f06-a785-4283-861c-1ddf2eea2d55-kube-api-access-7ckps\") pod \"node-ca-bxhl9\" (UID: \"151a5f06-a785-4283-861c-1ddf2eea2d55\") " pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-run-systemd\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-system-cni-dir\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.004570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05ea45eb-026f-49f0-9ebb-f60175c8d22a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.005176 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.004356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-registration-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.008082 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.008061 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:29:29.036827 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.036798 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fhvq8" Jul 07 15:29:29.046022 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.045995 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fhvq8" Jul 07 15:29:29.092793 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.092759 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 15:29:29.104707 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104673 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8108322-2c7b-4153-a665-853cabc0ab11-hosts-file\") pod \"node-resolver-6bs9m\" (UID: \"c8108322-2c7b-4153-a665-853cabc0ab11\") " pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-cni-dir\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-var-lib-cni-multus\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2x8r\" (UniqueName: \"kubernetes.io/projected/f59e9c40-02cd-4132-bbda-7686d4583bd5-kube-api-access-q2x8r\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-sysctl-d\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104828 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8108322-2c7b-4153-a665-853cabc0ab11-hosts-file\") pod \"node-resolver-6bs9m\" (UID: \"c8108322-2c7b-4153-a665-853cabc0ab11\") " pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-systemd-units\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104827 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-var-lib-cni-multus\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104834 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-cni-dir\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-cni-bin\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-systemd-units\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.104891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-ovn-node-metrics-cert\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-run-multus-certs\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104942 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-cni-bin\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-etc-kubernetes\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-log-socket\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.104996 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-run-multus-certs\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105012 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-etc-kubernetes\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03c89f85-a9fe-4ac3-beab-8c51f067a9da-kubelet-config\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-log-socket\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03c89f85-a9fe-4ac3-beab-8c51f067a9da-dbus\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105066 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03c89f85-a9fe-4ac3-beab-8c51f067a9da-kubelet-config\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/151a5f06-a785-4283-861c-1ddf2eea2d55-host\") pod \"node-ca-bxhl9\" (UID: \"151a5f06-a785-4283-861c-1ddf2eea2d55\") " pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105106 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/151a5f06-a785-4283-861c-1ddf2eea2d55-host\") pod \"node-ca-bxhl9\" (UID: \"151a5f06-a785-4283-861c-1ddf2eea2d55\") " pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-run-openvswitch\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105197 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-socket-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03c89f85-a9fe-4ac3-beab-8c51f067a9da-dbus\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105266 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-run-openvswitch\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.105454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-run-ovn\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-ovnkube-script-lib\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj9rz\" (UniqueName: \"kubernetes.io/projected/05ea45eb-026f-49f0-9ebb-f60175c8d22a-kube-api-access-hj9rz\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105361 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-run-ovn\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-systemd\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105317 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f59e9c40-02cd-4132-bbda-7686d4583bd5-cni-binary-copy\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-socket-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-socket-dir-parent\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105400 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-hostroot\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-var-lib-openvswitch\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-hostroot\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105587 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-socket-dir-parent\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105649 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-ovnkube-config\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e10241ad-8010-43b1-a4d0-5f855868fab7-konnectivity-ca\") pod \"konnectivity-agent-bf5s6\" (UID: \"e10241ad-8010-43b1-a4d0-5f855868fab7\") " pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:29.106319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105692 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105692 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.105737 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-node-log\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106250 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f59e9c40-02cd-4132-bbda-7686d4583bd5-cni-binary-copy\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106273 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e10241ad-8010-43b1-a4d0-5f855868fab7-konnectivity-ca\") pod \"konnectivity-agent-bf5s6\" (UID: \"e10241ad-8010-43b1-a4d0-5f855868fab7\") " pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106273 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-ovnkube-script-lib\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-sysconfig\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106405 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-var-lib-openvswitch\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106408 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-node-log\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106421 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-run\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-sys\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-lib-modules\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6-host-slash\") pod \"iptables-alerter-254gg\" (UID: \"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6\") " pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-run-netns\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106588 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6-host-slash\") pod \"iptables-alerter-254gg\" (UID: \"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6\") " pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.106926 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106610 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-kubernetes\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106615 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-run-netns\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m7pr\" (UniqueName: \"kubernetes.io/projected/c8108322-2c7b-4153-a665-853cabc0ab11-kube-api-access-2m7pr\") pod \"node-resolver-6bs9m\" (UID: \"c8108322-2c7b-4153-a665-853cabc0ab11\") " pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106689 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-cnibin\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-run-k8s-cni-cncf-io\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106728 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-ovnkube-config\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.106691 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.106733 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-run-netns\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-kubelet\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.106792 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs podName:dbd0a65c-3da5-4f09-b99d-2551a7e33c93 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:29.606777625 +0000 UTC m=+3.029496839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs") pod "network-metrics-daemon-bnnp4" (UID: "dbd0a65c-3da5-4f09-b99d-2551a7e33c93") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106820 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-kubelet\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106834 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-run-netns\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106857 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-run-k8s-cni-cncf-io\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.106865 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret podName:03c89f85-a9fe-4ac3-beab-8c51f067a9da nodeName:}" failed. No retries permitted until 2026-07-07 15:29:29.606847438 +0000 UTC m=+3.029566658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret") pod "global-pull-secret-syncer-xfktn" (UID: "03c89f85-a9fe-4ac3-beab-8c51f067a9da") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-slash\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.107697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106898 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-cnibin\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-sysctl-conf\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8108322-2c7b-4153-a665-853cabc0ab11-tmp-dir\") pod \"node-resolver-6bs9m\" (UID: \"c8108322-2c7b-4153-a665-853cabc0ab11\") " pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106946 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-slash\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.106985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-var-lib-kubelet\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-env-overrides\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vplqm\" (UniqueName: \"kubernetes.io/projected/1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6-kube-api-access-vplqm\") pod \"iptables-alerter-254gg\" (UID: \"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6\") " pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107066 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/151a5f06-a785-4283-861c-1ddf2eea2d55-serviceca\") pod \"node-ca-bxhl9\" (UID: \"151a5f06-a785-4283-861c-1ddf2eea2d55\") " pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-os-release\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-run-ovn-kubernetes\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05ea45eb-026f-49f0-9ebb-f60175c8d22a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107189 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-tuned\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c9fccf0-186b-46b8-9c01-cf55353919f6-tmp\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107216 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8108322-2c7b-4153-a665-853cabc0ab11-tmp-dir\") pod \"node-resolver-6bs9m\" (UID: \"c8108322-2c7b-4153-a665-853cabc0ab11\") " pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6-iptables-alerter-script\") pod \"iptables-alerter-254gg\" (UID: \"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6\") " pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-daemon-config\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-etc-openvswitch\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.108312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2mww\" (UniqueName: \"kubernetes.io/projected/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-kube-api-access-v2mww\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107387 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-cnibin\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e10241ad-8010-43b1-a4d0-5f855868fab7-agent-certs\") pod \"konnectivity-agent-bf5s6\" (UID: \"e10241ad-8010-43b1-a4d0-5f855868fab7\") " pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-host\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbhlt\" (UniqueName: \"kubernetes.io/projected/5c9fccf0-186b-46b8-9c01-cf55353919f6-kube-api-access-bbhlt\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ckps\" (UniqueName: \"kubernetes.io/projected/151a5f06-a785-4283-861c-1ddf2eea2d55-kube-api-access-7ckps\") pod \"node-ca-bxhl9\" (UID: \"151a5f06-a785-4283-861c-1ddf2eea2d55\") " pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107493 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-env-overrides\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-run-systemd\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-system-cni-dir\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107552 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-run-ovn-kubernetes\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05ea45eb-026f-49f0-9ebb-f60175c8d22a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107592 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-registration-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-sys-fs\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-modprobe-d\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-system-cni-dir\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-var-lib-cni-bin\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-conf-dir\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.108841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-device-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107789 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56dcv\" (UniqueName: \"kubernetes.io/projected/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-kube-api-access-56dcv\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6-iptables-alerter-script\") pod \"iptables-alerter-254gg\" (UID: \"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6\") " pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-var-lib-kubelet\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107843 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-cni-netd\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-os-release\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05ea45eb-026f-49f0-9ebb-f60175c8d22a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107928 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107954 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107966 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05ea45eb-026f-49f0-9ebb-f60175c8d22a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.107981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8l9r\" (UniqueName: \"kubernetes.io/projected/82446fb3-497f-4c20-9e68-e34b98273d2f-kube-api-access-z8l9r\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05ea45eb-026f-49f0-9ebb-f60175c8d22a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108301 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-daemon-config\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108364 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-multus-conf-dir\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-cnibin\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108508 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-device-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108740 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-os-release\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.109489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-var-lib-kubelet\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-host-cni-netd\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108819 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/151a5f06-a785-4283-861c-1ddf2eea2d55-serviceca\") pod \"node-ca-bxhl9\" (UID: \"151a5f06-a785-4283-861c-1ddf2eea2d55\") " pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108838 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-sys-fs\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108872 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82446fb3-497f-4c20-9e68-e34b98273d2f-registration-dir\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108906 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-os-release\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.108965 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-system-cni-dir\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.109011 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f59e9c40-02cd-4132-bbda-7686d4583bd5-host-var-lib-cni-bin\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.109060 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-system-cni-dir\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.109077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-etc-openvswitch\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.109090 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-run-systemd\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.109114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05ea45eb-026f-49f0-9ebb-f60175c8d22a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.110288 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.109247 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05ea45eb-026f-49f0-9ebb-f60175c8d22a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.111099 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.111079 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-ovn-node-metrics-cert\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.111590 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.111566 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e10241ad-8010-43b1-a4d0-5f855868fab7-agent-certs\") pod \"konnectivity-agent-bf5s6\" (UID: \"e10241ad-8010-43b1-a4d0-5f855868fab7\") " pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:29.117674 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.117645 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2x8r\" (UniqueName: \"kubernetes.io/projected/f59e9c40-02cd-4132-bbda-7686d4583bd5-kube-api-access-q2x8r\") pod \"multus-2b8zr\" (UID: \"f59e9c40-02cd-4132-bbda-7686d4583bd5\") " pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.117819 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.117748 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj9rz\" (UniqueName: \"kubernetes.io/projected/05ea45eb-026f-49f0-9ebb-f60175c8d22a-kube-api-access-hj9rz\") pod \"multus-additional-cni-plugins-jq5hb\" (UID: \"05ea45eb-026f-49f0-9ebb-f60175c8d22a\") " pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.130683 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.130653 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m7pr\" (UniqueName: \"kubernetes.io/projected/c8108322-2c7b-4153-a665-853cabc0ab11-kube-api-access-2m7pr\") pod \"node-resolver-6bs9m\" (UID: \"c8108322-2c7b-4153-a665-853cabc0ab11\") " pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.131174 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.131098 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:29:29.131308 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.131180 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:29:29.131308 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.131222 2561 projected.go:196] Error preparing data for projected volume kube-api-access-8jswp for pod openshift-network-diagnostics/network-check-target-qc9dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:29.131308 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.131298 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp podName:a9ff7c83-4f17-49d0-9601-31e2372bf3d5 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:29.631270328 +0000 UTC m=+3.053989555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8jswp" (UniqueName: "kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp") pod "network-check-target-qc9dm" (UID: "a9ff7c83-4f17-49d0-9601-31e2372bf3d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:29.131554 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.131116 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vplqm\" (UniqueName: \"kubernetes.io/projected/1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6-kube-api-access-vplqm\") pod \"iptables-alerter-254gg\" (UID: \"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6\") " pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.131646 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.131623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8l9r\" (UniqueName: \"kubernetes.io/projected/82446fb3-497f-4c20-9e68-e34b98273d2f-kube-api-access-z8l9r\") pod \"aws-ebs-csi-driver-node-s7blr\" (UID: \"82446fb3-497f-4c20-9e68-e34b98273d2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.134725 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.134698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56dcv\" (UniqueName: \"kubernetes.io/projected/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-kube-api-access-56dcv\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:29.134841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.134745 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2mww\" (UniqueName: \"kubernetes.io/projected/3ae5be7b-e2f5-4a3e-bf16-7157234eb51f-kube-api-access-v2mww\") pod \"ovnkube-node-8smmh\" (UID: \"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f\") " pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.137107 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.137080 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ckps\" (UniqueName: \"kubernetes.io/projected/151a5f06-a785-4283-861c-1ddf2eea2d55-kube-api-access-7ckps\") pod \"node-ca-bxhl9\" (UID: \"151a5f06-a785-4283-861c-1ddf2eea2d55\") " pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.159755 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.159714 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal" event={"ID":"de6ff4e436b18660880403245e7c2ccf","Type":"ContainerStarted","Data":"ac2d094df7e0618df094a0d9e90599d252ada43d60e85e67b74a798865ae1cd8"} Jul 07 15:29:29.208552 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-tuned\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.208552 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c9fccf0-186b-46b8-9c01-cf55353919f6-tmp\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.208777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-host\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.208777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbhlt\" (UniqueName: \"kubernetes.io/projected/5c9fccf0-186b-46b8-9c01-cf55353919f6-kube-api-access-bbhlt\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.208777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-modprobe-d\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.208777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-sysctl-d\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.208777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-systemd\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.208777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-sysconfig\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.208777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-run\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209014 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208789 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-sys\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209014 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-lib-modules\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209014 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-kubernetes\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209014 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-sysctl-conf\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209014 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.208911 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-var-lib-kubelet\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209215 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-var-lib-kubelet\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209274 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-systemd\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209330 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-sys\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209330 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-kubernetes\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209330 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209282 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-sysconfig\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209330 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-run\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209524 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209389 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-lib-modules\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209524 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-modprobe-d\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209524 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209454 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-host\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209524 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209461 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-sysctl-conf\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.209755 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.209522 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-sysctl-d\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.212070 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.212045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c9fccf0-186b-46b8-9c01-cf55353919f6-tmp\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.212216 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.212091 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c9fccf0-186b-46b8-9c01-cf55353919f6-etc-tuned\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.220674 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.220610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbhlt\" (UniqueName: \"kubernetes.io/projected/5c9fccf0-186b-46b8-9c01-cf55353919f6-kube-api-access-bbhlt\") pod \"tuned-6vjkq\" (UID: \"5c9fccf0-186b-46b8-9c01-cf55353919f6\") " pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.286043 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.286005 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bs9m" Jul 07 15:29:29.295013 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.294982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-254gg" Jul 07 15:29:29.298116 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:29.298089 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8108322_2c7b_4153_a665_853cabc0ab11.slice/crio-16fb2657cf2b8963ca5f11ea5e3050f896eef82ba99802b6ae1664379bf9c94a WatchSource:0}: Error finding container 16fb2657cf2b8963ca5f11ea5e3050f896eef82ba99802b6ae1664379bf9c94a: Status 404 returned error can't find the container with id 16fb2657cf2b8963ca5f11ea5e3050f896eef82ba99802b6ae1664379bf9c94a Jul 07 15:29:29.305370 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.303841 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:29.305370 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:29.304480 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1816c4_0a6d_476f_ac5a_1a3e16d1e0a6.slice/crio-8600670f952cc74523a0520ea83005c8ed5163890a6814dcdc7fdaf76bb81efc WatchSource:0}: Error finding container 8600670f952cc74523a0520ea83005c8ed5163890a6814dcdc7fdaf76bb81efc: Status 404 returned error can't find the container with id 8600670f952cc74523a0520ea83005c8ed5163890a6814dcdc7fdaf76bb81efc Jul 07 15:29:29.310878 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.310843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxhl9" Jul 07 15:29:29.315376 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:29.315347 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10241ad_8010_43b1_a4d0_5f855868fab7.slice/crio-f63c9588c86b4acfd263211ac2e7a625cd89f2a54d7a7ed45f818255066895a4 WatchSource:0}: Error finding container f63c9588c86b4acfd263211ac2e7a625cd89f2a54d7a7ed45f818255066895a4: Status 404 returned error can't find the container with id f63c9588c86b4acfd263211ac2e7a625cd89f2a54d7a7ed45f818255066895a4 Jul 07 15:29:29.318944 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.318922 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2b8zr" Jul 07 15:29:29.322045 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:29.322018 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151a5f06_a785_4283_861c_1ddf2eea2d55.slice/crio-52d291bd49158bf2d771895d3b257807624d64bf0dbb88afd0ca939c95a873c2 WatchSource:0}: Error finding container 52d291bd49158bf2d771895d3b257807624d64bf0dbb88afd0ca939c95a873c2: Status 404 returned error can't find the container with id 52d291bd49158bf2d771895d3b257807624d64bf0dbb88afd0ca939c95a873c2 Jul 07 15:29:29.327074 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.327034 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:29.336026 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.336004 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" Jul 07 15:29:29.337316 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:29.337294 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae5be7b_e2f5_4a3e_bf16_7157234eb51f.slice/crio-d21b10e7fcd5b05bfc43cb9e4afa17ae75b034d23507880f16da0314cdd7de50 WatchSource:0}: Error finding container d21b10e7fcd5b05bfc43cb9e4afa17ae75b034d23507880f16da0314cdd7de50: Status 404 returned error can't find the container with id d21b10e7fcd5b05bfc43cb9e4afa17ae75b034d23507880f16da0314cdd7de50 Jul 07 15:29:29.343409 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.343387 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" Jul 07 15:29:29.345276 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:29.345249 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ea45eb_026f_49f0_9ebb_f60175c8d22a.slice/crio-12dea83514394561bafde0ef741079803fdb8c22fd8d21ff2d0cb61468190324 WatchSource:0}: Error finding container 12dea83514394561bafde0ef741079803fdb8c22fd8d21ff2d0cb61468190324: Status 404 returned error can't find the container with id 12dea83514394561bafde0ef741079803fdb8c22fd8d21ff2d0cb61468190324 Jul 07 15:29:29.352102 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.351911 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" Jul 07 15:29:29.360403 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:29.360369 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82446fb3_497f_4c20_9e68_e34b98273d2f.slice/crio-6c5ff9e169fc0e6a8da2f8a709202479bfc69379c4fff6a63e01fecf31cd6fe0 WatchSource:0}: Error finding container 6c5ff9e169fc0e6a8da2f8a709202479bfc69379c4fff6a63e01fecf31cd6fe0: Status 404 returned error can't find the container with id 6c5ff9e169fc0e6a8da2f8a709202479bfc69379c4fff6a63e01fecf31cd6fe0 Jul 07 15:29:29.368279 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:29:29.368217 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9fccf0_186b_46b8_9c01_cf55353919f6.slice/crio-54d6f001c888468e9a9e8b951963a7ad67d86e2e37217317f3d0fa7ef63fd92f WatchSource:0}: Error finding container 54d6f001c888468e9a9e8b951963a7ad67d86e2e37217317f3d0fa7ef63fd92f: Status 404 returned error can't find the container with id 54d6f001c888468e9a9e8b951963a7ad67d86e2e37217317f3d0fa7ef63fd92f Jul 07 15:29:29.514880 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.514791 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:29:29.612259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.612216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:29.612259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.612262 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:29.612510 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.612381 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:29.612510 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.612441 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret podName:03c89f85-a9fe-4ac3-beab-8c51f067a9da nodeName:}" failed. No retries permitted until 2026-07-07 15:29:30.612427168 +0000 UTC m=+4.035146383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret") pod "global-pull-secret-syncer-xfktn" (UID: "03c89f85-a9fe-4ac3-beab-8c51f067a9da") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:29.612510 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.612381 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:29.612510 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.612508 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs podName:dbd0a65c-3da5-4f09-b99d-2551a7e33c93 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:30.612495504 +0000 UTC m=+4.035214733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs") pod "network-metrics-daemon-bnnp4" (UID: "dbd0a65c-3da5-4f09-b99d-2551a7e33c93") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:29.712608 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:29.712572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:29.715486 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.713075 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:29:29.715486 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.713110 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:29:29.715486 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.713136 2561 projected.go:196] Error preparing data for projected volume kube-api-access-8jswp for pod openshift-network-diagnostics/network-check-target-qc9dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:29.715486 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:29.713245 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp podName:a9ff7c83-4f17-49d0-9601-31e2372bf3d5 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:30.713213793 +0000 UTC m=+4.135933028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jswp" (UniqueName: "kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp") pod "network-check-target-qc9dm" (UID: "a9ff7c83-4f17-49d0-9601-31e2372bf3d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:30.049068 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.048925 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:24:29 +0000 UTC" deadline="2028-04-09 19:58:05.109334126 +0000 UTC" Jul 07 15:29:30.049068 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.048998 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15412h28m35.060341427s" Jul 07 15:29:30.154544 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.154496 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:30.154747 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:30.154639 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:30.165916 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.165829 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2b8zr" event={"ID":"f59e9c40-02cd-4132-bbda-7686d4583bd5","Type":"ContainerStarted","Data":"135c86c0d084b0287e0d458c18b2bb803b6da8ed7f34c6a739527d59b0d4141d"} Jul 07 15:29:30.168592 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.168518 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bf5s6" event={"ID":"e10241ad-8010-43b1-a4d0-5f855868fab7","Type":"ContainerStarted","Data":"f63c9588c86b4acfd263211ac2e7a625cd89f2a54d7a7ed45f818255066895a4"} Jul 07 15:29:30.173020 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.172988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-254gg" event={"ID":"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6","Type":"ContainerStarted","Data":"8600670f952cc74523a0520ea83005c8ed5163890a6814dcdc7fdaf76bb81efc"} Jul 07 15:29:30.175059 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.175030 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" event={"ID":"5c9fccf0-186b-46b8-9c01-cf55353919f6","Type":"ContainerStarted","Data":"54d6f001c888468e9a9e8b951963a7ad67d86e2e37217317f3d0fa7ef63fd92f"} Jul 07 15:29:30.178214 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.178177 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" event={"ID":"82446fb3-497f-4c20-9e68-e34b98273d2f","Type":"ContainerStarted","Data":"6c5ff9e169fc0e6a8da2f8a709202479bfc69379c4fff6a63e01fecf31cd6fe0"} Jul 07 15:29:30.180651 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.180536 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" event={"ID":"05ea45eb-026f-49f0-9ebb-f60175c8d22a","Type":"ContainerStarted","Data":"12dea83514394561bafde0ef741079803fdb8c22fd8d21ff2d0cb61468190324"} Jul 07 15:29:30.182571 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.182545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" event={"ID":"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f","Type":"ContainerStarted","Data":"d21b10e7fcd5b05bfc43cb9e4afa17ae75b034d23507880f16da0314cdd7de50"} Jul 07 15:29:30.184413 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.184387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxhl9" event={"ID":"151a5f06-a785-4283-861c-1ddf2eea2d55","Type":"ContainerStarted","Data":"52d291bd49158bf2d771895d3b257807624d64bf0dbb88afd0ca939c95a873c2"} Jul 07 15:29:30.187619 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.187572 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bs9m" event={"ID":"c8108322-2c7b-4153-a665-853cabc0ab11","Type":"ContainerStarted","Data":"16fb2657cf2b8963ca5f11ea5e3050f896eef82ba99802b6ae1664379bf9c94a"} Jul 07 15:29:30.620095 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.619696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:30.620296 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.620126 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:30.620296 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:30.620287 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:30.620405 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:30.620343 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs podName:dbd0a65c-3da5-4f09-b99d-2551a7e33c93 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:32.620328207 +0000 UTC m=+6.043047424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs") pod "network-metrics-daemon-bnnp4" (UID: "dbd0a65c-3da5-4f09-b99d-2551a7e33c93") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:30.620794 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:30.620774 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:30.620878 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:30.620834 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret podName:03c89f85-a9fe-4ac3-beab-8c51f067a9da nodeName:}" failed. No retries permitted until 2026-07-07 15:29:32.620818149 +0000 UTC m=+6.043537379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret") pod "global-pull-secret-syncer-xfktn" (UID: "03c89f85-a9fe-4ac3-beab-8c51f067a9da") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:30.721199 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:30.721052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:30.721360 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:30.721256 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:29:30.721360 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:30.721281 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:29:30.721360 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:30.721298 2561 projected.go:196] Error preparing data for projected volume kube-api-access-8jswp for pod openshift-network-diagnostics/network-check-target-qc9dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:30.721526 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:30.721362 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp podName:a9ff7c83-4f17-49d0-9601-31e2372bf3d5 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:32.721341559 +0000 UTC m=+6.144060773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jswp" (UniqueName: "kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp") pod "network-check-target-qc9dm" (UID: "a9ff7c83-4f17-49d0-9601-31e2372bf3d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:31.049559 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:31.049423 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:24:29 +0000 UTC" deadline="2028-01-14 20:34:16.681525098 +0000 UTC" Jul 07 15:29:31.049559 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:31.049468 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13349h4m45.6320624s" Jul 07 15:29:31.155036 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:31.154527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:31.155036 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:31.154561 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:31.155036 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:31.154675 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:31.155036 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:31.154757 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:32.154742 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:32.154153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:32.154742 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:32.154299 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:32.204463 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:32.204421 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" event={"ID":"d3225c1113471be6cc2c3784a8387dcd","Type":"ContainerStarted","Data":"66518bddb04747c693da86baf36b63959273bb48848fa2cb996bc96eccf7343c"} Jul 07 15:29:32.211381 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:32.211347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal" event={"ID":"de6ff4e436b18660880403245e7c2ccf","Type":"ContainerStarted","Data":"87ad1fdb4c7c7c2e5d5b4d742438caa74bdb292e8dd76d8c0205512a866d1a21"} Jul 07 15:29:32.640182 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:32.640086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:32.640182 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:32.640145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:32.640431 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:32.640388 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:32.640489 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:32.640458 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs podName:dbd0a65c-3da5-4f09-b99d-2551a7e33c93 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:36.640437223 +0000 UTC m=+10.063156440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs") pod "network-metrics-daemon-bnnp4" (UID: "dbd0a65c-3da5-4f09-b99d-2551a7e33c93") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:32.641332 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:32.641307 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:32.641483 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:32.641385 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret podName:03c89f85-a9fe-4ac3-beab-8c51f067a9da nodeName:}" failed. No retries permitted until 2026-07-07 15:29:36.641354629 +0000 UTC m=+10.064073847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret") pod "global-pull-secret-syncer-xfktn" (UID: "03c89f85-a9fe-4ac3-beab-8c51f067a9da") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:32.741487 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:32.741444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:32.741667 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:32.741600 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:29:32.741667 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:32.741624 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:29:32.741667 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:32.741637 2561 projected.go:196] Error preparing data for projected volume kube-api-access-8jswp for pod openshift-network-diagnostics/network-check-target-qc9dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:32.741847 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:32.741714 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp podName:a9ff7c83-4f17-49d0-9601-31e2372bf3d5 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:36.741678995 +0000 UTC m=+10.164398233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jswp" (UniqueName: "kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp") pod "network-check-target-qc9dm" (UID: "a9ff7c83-4f17-49d0-9601-31e2372bf3d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:33.156909 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:33.156384 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:33.156909 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:33.156519 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:33.156909 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:33.156519 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:33.156909 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:33.156608 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:34.154169 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:34.154060 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:34.154352 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:34.154212 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:34.226592 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:34.226550 2561 generic.go:356] "Generic (PLEG): container finished" podID="d3225c1113471be6cc2c3784a8387dcd" containerID="66518bddb04747c693da86baf36b63959273bb48848fa2cb996bc96eccf7343c" exitCode=0 Jul 07 15:29:34.227064 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:34.226610 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" event={"ID":"d3225c1113471be6cc2c3784a8387dcd","Type":"ContainerDied","Data":"66518bddb04747c693da86baf36b63959273bb48848fa2cb996bc96eccf7343c"} Jul 07 15:29:34.248296 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:34.247943 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-86.ec2.internal" podStartSLOduration=5.247861916 podStartE2EDuration="5.247861916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:32.252776497 +0000 UTC m=+5.675495736" watchObservedRunningTime="2026-07-07 15:29:34.247861916 +0000 UTC m=+7.670581155" Jul 07 15:29:35.154234 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:35.154198 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:35.154402 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:35.154353 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:35.154811 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:35.154783 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:35.154963 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:35.154920 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:36.154797 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:36.154738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:36.155296 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:36.155084 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:36.675684 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:36.675639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:36.675880 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:36.675698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:36.675880 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:36.675826 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:36.675880 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:36.675828 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:36.676030 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:36.675898 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs podName:dbd0a65c-3da5-4f09-b99d-2551a7e33c93 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:44.6758774 +0000 UTC m=+18.098596615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs") pod "network-metrics-daemon-bnnp4" (UID: "dbd0a65c-3da5-4f09-b99d-2551a7e33c93") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:36.676030 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:36.675920 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret podName:03c89f85-a9fe-4ac3-beab-8c51f067a9da nodeName:}" failed. No retries permitted until 2026-07-07 15:29:44.675908742 +0000 UTC m=+18.098627956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret") pod "global-pull-secret-syncer-xfktn" (UID: "03c89f85-a9fe-4ac3-beab-8c51f067a9da") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:36.776200 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:36.776138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:36.776386 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:36.776350 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:29:36.776386 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:36.776372 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:29:36.776386 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:36.776385 2561 projected.go:196] Error preparing data for projected volume kube-api-access-8jswp for pod openshift-network-diagnostics/network-check-target-qc9dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:36.776577 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:36.776450 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp podName:a9ff7c83-4f17-49d0-9601-31e2372bf3d5 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:44.776429024 +0000 UTC m=+18.199148259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jswp" (UniqueName: "kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp") pod "network-check-target-qc9dm" (UID: "a9ff7c83-4f17-49d0-9601-31e2372bf3d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:37.156171 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:37.155475 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:37.156171 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:37.155614 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:37.156171 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:37.155979 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:37.156171 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:37.156081 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:38.154005 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:38.153908 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:38.154219 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:38.154053 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:39.154424 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:39.154369 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:39.154424 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:39.154420 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:39.154960 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:39.154540 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:39.154960 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:39.154674 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:40.154121 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:40.154081 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:40.154317 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:40.154248 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:41.157217 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:41.157188 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:41.157633 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:41.157314 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:41.157701 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:41.157656 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:41.157770 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:41.157739 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:42.153790 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:42.153758 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:42.153953 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:42.153881 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:42.250056 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:42.250018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" event={"ID":"d3225c1113471be6cc2c3784a8387dcd","Type":"ContainerStarted","Data":"fac8e4f2a862b4126ab36c3819fd0035987f99db7105b54a21b8ce583ec46f58"} Jul 07 15:29:42.269554 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:42.269506 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-86.ec2.internal" podStartSLOduration=13.269486589 podStartE2EDuration="13.269486589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:42.268931328 +0000 UTC m=+15.691650562" watchObservedRunningTime="2026-07-07 15:29:42.269486589 +0000 UTC m=+15.692205823" Jul 07 15:29:43.157831 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:43.157348 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:43.157831 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:43.157388 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:43.157831 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:43.157490 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:43.157831 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:43.157658 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:44.153756 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:44.153723 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:44.154281 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:44.153849 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:44.737716 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:44.737673 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:44.737716 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:44.737731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:44.738013 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:44.737837 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:44.738013 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:44.737859 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:44.738013 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:44.737894 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret podName:03c89f85-a9fe-4ac3-beab-8c51f067a9da nodeName:}" failed. No retries permitted until 2026-07-07 15:30:00.73788128 +0000 UTC m=+34.160600495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret") pod "global-pull-secret-syncer-xfktn" (UID: "03c89f85-a9fe-4ac3-beab-8c51f067a9da") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:29:44.738013 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:44.737908 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs podName:dbd0a65c-3da5-4f09-b99d-2551a7e33c93 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:00.737902122 +0000 UTC m=+34.160621335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs") pod "network-metrics-daemon-bnnp4" (UID: "dbd0a65c-3da5-4f09-b99d-2551a7e33c93") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:29:44.839023 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:44.838990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:44.839236 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:44.839201 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:29:44.839236 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:44.839223 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:29:44.839355 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:44.839239 2561 projected.go:196] Error preparing data for projected volume kube-api-access-8jswp for pod openshift-network-diagnostics/network-check-target-qc9dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:44.839355 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:44.839297 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp podName:a9ff7c83-4f17-49d0-9601-31e2372bf3d5 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:00.839279219 +0000 UTC m=+34.261998432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jswp" (UniqueName: "kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp") pod "network-check-target-qc9dm" (UID: "a9ff7c83-4f17-49d0-9601-31e2372bf3d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:29:45.153922 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:45.153839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:45.154390 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:45.153988 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:45.154390 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:45.154005 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:45.154390 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:45.154111 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:46.153872 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:46.153831 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:46.154063 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:46.153984 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:47.154912 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:47.154875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:47.155418 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:47.155000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:47.155418 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:47.155013 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:47.155418 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:47.155135 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:48.153615 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:48.153581 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:48.153799 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:48.153708 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:49.154578 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:49.154537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:49.155104 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:49.154586 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:49.155104 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:49.154682 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:49.155104 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:49.154818 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:50.154734 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.154433 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:50.155377 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:50.154813 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:50.266909 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.266873 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" event={"ID":"5c9fccf0-186b-46b8-9c01-cf55353919f6","Type":"ContainerStarted","Data":"99585a1a5976b2ad51e322abf67b60aed4ed75e27620a250f1e4958044792770"} Jul 07 15:29:50.268355 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.268333 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" event={"ID":"82446fb3-497f-4c20-9e68-e34b98273d2f","Type":"ContainerStarted","Data":"fbbe2f3d7af800aaf619972cafef7992f38095473188066e2b033b49ed4d3929"} Jul 07 15:29:50.269699 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.269675 2561 generic.go:356] "Generic (PLEG): container finished" podID="05ea45eb-026f-49f0-9ebb-f60175c8d22a" containerID="0512e6583d991cbe8f53f6979c4ae48cfe3825af914d970b20546ea13a01489f" exitCode=0 Jul 07 15:29:50.269788 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.269746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" event={"ID":"05ea45eb-026f-49f0-9ebb-f60175c8d22a","Type":"ContainerDied","Data":"0512e6583d991cbe8f53f6979c4ae48cfe3825af914d970b20546ea13a01489f"} Jul 07 15:29:50.272910 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.272889 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" event={"ID":"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f","Type":"ContainerStarted","Data":"bb021f854d5f8e8f231f1d3f851e0faadf04772334d8ce2436249e7b69399954"} Jul 07 15:29:50.272996 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.272948 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" event={"ID":"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f","Type":"ContainerStarted","Data":"59b65818351b014b38e51632b8c4e2a1f1b4e9ad6a4259173634403200523899"} Jul 07 15:29:50.272996 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.272979 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" event={"ID":"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f","Type":"ContainerStarted","Data":"d4d0f9f8cbc8ea161e3b9d0113328c33f6d57c06445b0358f45a2f58b033372c"} Jul 07 15:29:50.273108 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.273016 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" event={"ID":"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f","Type":"ContainerStarted","Data":"dc751264e4ca29880a5045c542b6472b82740924399d59a74f0e957b4cb4a969"} Jul 07 15:29:50.273108 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.273048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" event={"ID":"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f","Type":"ContainerStarted","Data":"87e04366a7bc6b9e6c5777b46455efddf989661cb8f9c8d8dcba43fd8add99cf"} Jul 07 15:29:50.273108 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.273076 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" event={"ID":"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f","Type":"ContainerStarted","Data":"1dc84d95b18bc7c8e01340eb3565ae125dd237fbcbfcc8afee34082125751ea9"} Jul 07 15:29:50.274319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.274287 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxhl9" event={"ID":"151a5f06-a785-4283-861c-1ddf2eea2d55","Type":"ContainerStarted","Data":"b3c1193d5624793906c347ade4b7b91b0835787a11ee8f5a41edea60006f50a9"} Jul 07 15:29:50.275504 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.275483 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bs9m" event={"ID":"c8108322-2c7b-4153-a665-853cabc0ab11","Type":"ContainerStarted","Data":"971dae2d49481d4093144b90088393d1b8ab247b827c0538d7bbae59a07d47d2"} Jul 07 15:29:50.276846 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.276824 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2b8zr" event={"ID":"f59e9c40-02cd-4132-bbda-7686d4583bd5","Type":"ContainerStarted","Data":"39ee84da760b2fe30fc25570f53172227dd12f0b3878368f0cee9ef333682642"} Jul 07 15:29:50.278053 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.278034 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bf5s6" event={"ID":"e10241ad-8010-43b1-a4d0-5f855868fab7","Type":"ContainerStarted","Data":"adda27212510ac87e0de435175971ce3930ffb9131f6598553a01af4c8132667"} Jul 07 15:29:50.291857 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.291814 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6vjkq" podStartSLOduration=2.122759223 podStartE2EDuration="22.291803055s" totalImagesPullingTime="20.169043832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:50.291368852 +0000 UTC m=+23.714088097" watchObservedRunningTime="2026-07-07 15:29:50.291803055 +0000 UTC m=+23.714522622" Jul 07 15:29:50.311006 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.310921 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bf5s6" podStartSLOduration=10.407164897 podStartE2EDuration="22.310909323s" totalImagesPullingTime="11.903744426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:50.31065712 +0000 UTC m=+23.733376354" watchObservedRunningTime="2026-07-07 15:29:50.310909323 +0000 UTC m=+23.733628557" Jul 07 15:29:50.331014 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.330978 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bxhl9" podStartSLOduration=10.43716243 podStartE2EDuration="22.33096456s" totalImagesPullingTime="11.89380213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:50.330426636 +0000 UTC m=+23.753145872" watchObservedRunningTime="2026-07-07 15:29:50.33096456 +0000 UTC m=+23.753683866" Jul 07 15:29:50.408669 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.408618 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6bs9m" podStartSLOduration=10.509979986 podStartE2EDuration="22.408602819s" totalImagesPullingTime="11.898622833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:50.407802693 +0000 UTC m=+23.830521927" watchObservedRunningTime="2026-07-07 15:29:50.408602819 +0000 UTC m=+23.831322053" Jul 07 15:29:50.442529 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.442476 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2b8zr" podStartSLOduration=2.178407285 podStartE2EDuration="22.442460112s" totalImagesPullingTime="20.264052827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:50.442402292 +0000 UTC m=+23.865121538" watchObservedRunningTime="2026-07-07 15:29:50.442460112 +0000 UTC m=+23.865179368" Jul 07 15:29:50.718965 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.718877 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:50.719517 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:50.719501 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:51.154577 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:51.154488 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:51.154577 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:51.154537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:51.154792 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:51.154647 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:51.154792 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:51.154738 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:51.281490 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:51.281425 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-254gg" event={"ID":"1a1816c4-0a6d-476f-ac5a-1a3e16d1e0a6","Type":"ContainerStarted","Data":"1152205b8d48ecd5a18882d8f1a0cfa3fb5af2eca5b98db03d8197d66359440e"} Jul 07 15:29:51.282089 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:51.282064 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:51.282489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:51.282475 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bf5s6" Jul 07 15:29:51.299356 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:51.299315 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-254gg" podStartSLOduration=11.387242197 podStartE2EDuration="23.299303181s" totalImagesPullingTime="11.912060984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:51.298749549 +0000 UTC m=+24.721468786" watchObservedRunningTime="2026-07-07 15:29:51.299303181 +0000 UTC m=+24.722022415" Jul 07 15:29:51.484275 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:51.484247 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 15:29:52.062951 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:52.062854 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:29:51.484265687Z","UUID":"123265c0-bdb9-4601-b79a-9969ca522bcc","Handler":null,"Name":"","Endpoint":""} Jul 07 15:29:52.064521 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:52.064499 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 15:29:52.064643 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:52.064537 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 15:29:52.154356 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:52.154330 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:52.154509 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:52.154433 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:52.285865 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:52.285832 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" event={"ID":"82446fb3-497f-4c20-9e68-e34b98273d2f","Type":"ContainerStarted","Data":"8b4f2a86f907fad7bcc4d9cc49522ce428b73c96c4a1a779c58ec5b40155900a"} Jul 07 15:29:52.292551 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:52.292523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" event={"ID":"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f","Type":"ContainerStarted","Data":"7014364f01ec1114d4dbc86b89f763eed63f3050db1c267d34e413796a639870"} Jul 07 15:29:53.154602 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:53.154424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:53.154767 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:53.154424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:53.154767 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:53.154685 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:53.154853 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:53.154766 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:53.296512 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:53.296434 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" event={"ID":"82446fb3-497f-4c20-9e68-e34b98273d2f","Type":"ContainerStarted","Data":"c7957ac08ddfd850b16a28ae41f9aadecac084d46f94ac1942968ff99dec8ea7"} Jul 07 15:29:53.319616 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:53.319574 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7blr" podStartSLOduration=10.360155016 podStartE2EDuration="25.31956084s" totalImagesPullingTime="14.959405824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:53.319421416 +0000 UTC m=+26.742140641" watchObservedRunningTime="2026-07-07 15:29:53.31956084 +0000 UTC m=+26.742280073" Jul 07 15:29:54.154151 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:54.154105 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:54.154356 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:54.154241 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:55.154649 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:55.154477 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:55.155260 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:55.154478 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:55.155260 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:55.154731 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:55.155260 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:55.154799 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:55.304552 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:55.304516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" event={"ID":"3ae5be7b-e2f5-4a3e-bf16-7157234eb51f","Type":"ContainerStarted","Data":"f19cf8568df443ac173a38b85ff758a73afd4342936e9e12a7429aca7e241cb3"} Jul 07 15:29:55.304804 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:55.304789 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:55.304872 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:55.304853 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:55.324185 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:55.324160 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:55.324355 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:55.324341 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:55.340968 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:55.340914 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" podStartSLOduration=7.076190461 podStartE2EDuration="27.34089039s" totalImagesPullingTime="20.264699929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:55.339998663 +0000 UTC m=+28.762717898" watchObservedRunningTime="2026-07-07 15:29:55.34089039 +0000 UTC m=+28.763609636" Jul 07 15:29:56.153597 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:56.153564 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:56.153830 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:56.153707 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:56.308198 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:56.308166 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 15:29:56.767505 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:56.767464 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bnnp4"] Jul 07 15:29:56.767716 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:56.767660 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:56.767781 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:56.767760 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:56.771529 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:56.771501 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qc9dm"] Jul 07 15:29:56.771684 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:56.771561 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfktn"] Jul 07 15:29:56.771684 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:56.771640 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:56.771795 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:56.771737 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:56.771851 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:56.771807 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:56.771908 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:56.771877 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:57.310305 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:57.310275 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 15:29:58.154404 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:58.154322 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:29:58.154404 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:58.154371 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:29:58.154585 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:58.154431 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:29:58.154585 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:58.154371 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:29:58.154585 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:58.154467 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:29:58.154585 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:29:58.154538 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:29:58.313876 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:58.313843 2561 generic.go:356] "Generic (PLEG): container finished" podID="05ea45eb-026f-49f0-9ebb-f60175c8d22a" containerID="1c02ed336a4f40429718c9d15e454d44c0df4a8659431a8e7e640bf1aa86837e" exitCode=0 Jul 07 15:29:58.314357 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:58.313895 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" event={"ID":"05ea45eb-026f-49f0-9ebb-f60175c8d22a","Type":"ContainerDied","Data":"1c02ed336a4f40429718c9d15e454d44c0df4a8659431a8e7e640bf1aa86837e"} Jul 07 15:29:58.483333 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:58.483295 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:29:59.317763 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:59.317729 2561 generic.go:356] "Generic (PLEG): container finished" podID="05ea45eb-026f-49f0-9ebb-f60175c8d22a" containerID="56e3bd987e94dbfaa5f471dbb37799fcbb114cdb804246eeefb80a39cd20737a" exitCode=0 Jul 07 15:29:59.318191 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:29:59.317782 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" event={"ID":"05ea45eb-026f-49f0-9ebb-f60175c8d22a","Type":"ContainerDied","Data":"56e3bd987e94dbfaa5f471dbb37799fcbb114cdb804246eeefb80a39cd20737a"} Jul 07 15:30:00.153713 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:00.153677 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:30:00.153857 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:00.153679 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:30:00.153857 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.153780 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfktn" podUID="03c89f85-a9fe-4ac3-beab-8c51f067a9da" Jul 07 15:30:00.153857 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:00.153800 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:30:00.153973 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.153872 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnnp4" podUID="dbd0a65c-3da5-4f09-b99d-2551a7e33c93" Jul 07 15:30:00.153973 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.153927 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qc9dm" podUID="a9ff7c83-4f17-49d0-9601-31e2372bf3d5" Jul 07 15:30:00.756034 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:00.755995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:30:00.756034 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:00.756035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:30:00.756631 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.756158 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:30:00.756631 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.756203 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:30:00.756631 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.756221 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret podName:03c89f85-a9fe-4ac3-beab-8c51f067a9da nodeName:}" failed. No retries permitted until 2026-07-07 15:30:32.756207423 +0000 UTC m=+66.178926634 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret") pod "global-pull-secret-syncer-xfktn" (UID: "03c89f85-a9fe-4ac3-beab-8c51f067a9da") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:30:00.756631 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.756255 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs podName:dbd0a65c-3da5-4f09-b99d-2551a7e33c93 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:32.756236782 +0000 UTC m=+66.178956011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs") pod "network-metrics-daemon-bnnp4" (UID: "dbd0a65c-3da5-4f09-b99d-2551a7e33c93") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:30:00.856594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:00.856570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:30:00.856707 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.856687 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:30:00.856754 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.856714 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:30:00.856754 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.856724 2561 projected.go:196] Error preparing data for projected volume kube-api-access-8jswp for pod openshift-network-diagnostics/network-check-target-qc9dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:30:00.856831 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:00.856772 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp podName:a9ff7c83-4f17-49d0-9601-31e2372bf3d5 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:32.856759682 +0000 UTC m=+66.279478894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8jswp" (UniqueName: "kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp") pod "network-check-target-qc9dm" (UID: "a9ff7c83-4f17-49d0-9601-31e2372bf3d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:30:01.325113 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.325032 2561 generic.go:356] "Generic (PLEG): container finished" podID="05ea45eb-026f-49f0-9ebb-f60175c8d22a" containerID="da89a31994e65f4e7a3a2c5694184ba14323f9a5b4f7189cd2fff7576980c2e3" exitCode=0 Jul 07 15:30:01.325272 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.325107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" event={"ID":"05ea45eb-026f-49f0-9ebb-f60175c8d22a","Type":"ContainerDied","Data":"da89a31994e65f4e7a3a2c5694184ba14323f9a5b4f7189cd2fff7576980c2e3"} Jul 07 15:30:01.347728 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.347702 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-86.ec2.internal" event="NodeReady" Jul 07 15:30:01.347867 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.347825 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 15:30:01.384351 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.384321 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d797cb784-4gjh6"] Jul 07 15:30:01.387136 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.387091 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.390110 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.390090 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 15:30:01.390253 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.390177 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 15:30:01.390253 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.390244 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 15:30:01.390361 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.390352 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wwv9f\"" Jul 07 15:30:01.395874 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.395854 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 15:30:01.399705 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.399687 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lhggt"] Jul 07 15:30:01.401647 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.401620 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.403541 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.403521 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d797cb784-4gjh6"] Jul 07 15:30:01.404197 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.404177 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xzcng"] Jul 07 15:30:01.404301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.404197 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 15:30:01.404301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.404242 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 15:30:01.404301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.404257 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5x8h\"" Jul 07 15:30:01.406200 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.406183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzcng" Jul 07 15:30:01.408635 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.408614 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bsljb\"" Jul 07 15:30:01.408635 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.408633 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 15:30:01.408797 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.408668 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 15:30:01.408797 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.408770 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 15:30:01.418795 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.418770 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzcng"] Jul 07 15:30:01.419549 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.419530 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lhggt"] Jul 07 15:30:01.461565 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.461525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-ca-trust-extracted\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.461768 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.461578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-trusted-ca\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.461768 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.461606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-certificates\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.461768 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.461666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-image-registry-private-configuration\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.461768 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.461691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.461768 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.461717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-installation-pull-secrets\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.461768 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.461743 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf47w\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-kube-api-access-gf47w\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.462041 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.461856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-bound-sa-token\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.563047 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-image-registry-private-configuration\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.563047 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.563312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-installation-pull-secrets\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.563312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563104 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf47w\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-kube-api-access-gf47w\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.563312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96351fd9-45ad-49b7-91da-f4a9df652546-tmp-dir\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.563312 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:01.563205 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 15:30:01.563312 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:01.563227 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d797cb784-4gjh6: secret "image-registry-tls" not found Jul 07 15:30:01.563312 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:01.563286 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls podName:5020ec8c-a735-4ff6-a6d0-5e6a78c77463 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:02.063265044 +0000 UTC m=+35.485984256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls") pod "image-registry-6d797cb784-4gjh6" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463") : secret "image-registry-tls" not found Jul 07 15:30:01.563312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96351fd9-45ad-49b7-91da-f4a9df652546-config-volume\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.563631 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k84jc\" (UniqueName: \"kubernetes.io/projected/96351fd9-45ad-49b7-91da-f4a9df652546-kube-api-access-k84jc\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.563631 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-bound-sa-token\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.563631 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-ca-trust-extracted\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.563631 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2drhc\" (UniqueName: \"kubernetes.io/projected/de760232-606f-4823-b39c-a721368b2211-kube-api-access-2drhc\") pod \"ingress-canary-xzcng\" (UID: \"de760232-606f-4823-b39c-a721368b2211\") " pod="openshift-ingress-canary/ingress-canary-xzcng" Jul 07 15:30:01.563631 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-trusted-ca\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.563631 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.563631 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-certificates\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.563631 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563581 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de760232-606f-4823-b39c-a721368b2211-cert\") pod \"ingress-canary-xzcng\" (UID: \"de760232-606f-4823-b39c-a721368b2211\") " pod="openshift-ingress-canary/ingress-canary-xzcng" Jul 07 15:30:01.564111 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.563819 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-ca-trust-extracted\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.564111 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.564056 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-certificates\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.564404 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.564386 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-trusted-ca\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.567035 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.567010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-image-registry-private-configuration\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.567035 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.567020 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-installation-pull-secrets\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.575030 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.575002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-bound-sa-token\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.575107 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.575082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf47w\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-kube-api-access-gf47w\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:01.664818 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.664773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.665008 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.664838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de760232-606f-4823-b39c-a721368b2211-cert\") pod \"ingress-canary-xzcng\" (UID: \"de760232-606f-4823-b39c-a721368b2211\") " pod="openshift-ingress-canary/ingress-canary-xzcng" Jul 07 15:30:01.665008 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:01.664921 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:30:01.665008 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.664953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96351fd9-45ad-49b7-91da-f4a9df652546-tmp-dir\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.665008 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:01.664974 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls podName:96351fd9-45ad-49b7-91da-f4a9df652546 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:02.164960807 +0000 UTC m=+35.587680022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls") pod "dns-default-lhggt" (UID: "96351fd9-45ad-49b7-91da-f4a9df652546") : secret "dns-default-metrics-tls" not found Jul 07 15:30:01.665008 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.665005 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96351fd9-45ad-49b7-91da-f4a9df652546-config-volume\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.665307 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.665021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k84jc\" (UniqueName: \"kubernetes.io/projected/96351fd9-45ad-49b7-91da-f4a9df652546-kube-api-access-k84jc\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.665307 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.665064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2drhc\" (UniqueName: \"kubernetes.io/projected/de760232-606f-4823-b39c-a721368b2211-kube-api-access-2drhc\") pod \"ingress-canary-xzcng\" (UID: \"de760232-606f-4823-b39c-a721368b2211\") " pod="openshift-ingress-canary/ingress-canary-xzcng" Jul 07 15:30:01.665307 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.665277 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96351fd9-45ad-49b7-91da-f4a9df652546-tmp-dir\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.665559 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.665543 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96351fd9-45ad-49b7-91da-f4a9df652546-config-volume\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.667313 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.667299 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de760232-606f-4823-b39c-a721368b2211-cert\") pod \"ingress-canary-xzcng\" (UID: \"de760232-606f-4823-b39c-a721368b2211\") " pod="openshift-ingress-canary/ingress-canary-xzcng" Jul 07 15:30:01.676633 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.676610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k84jc\" (UniqueName: \"kubernetes.io/projected/96351fd9-45ad-49b7-91da-f4a9df652546-kube-api-access-k84jc\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:01.676731 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.676617 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2drhc\" (UniqueName: \"kubernetes.io/projected/de760232-606f-4823-b39c-a721368b2211-kube-api-access-2drhc\") pod \"ingress-canary-xzcng\" (UID: \"de760232-606f-4823-b39c-a721368b2211\") " pod="openshift-ingress-canary/ingress-canary-xzcng" Jul 07 15:30:01.716876 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.716849 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzcng" Jul 07 15:30:01.855084 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:01.854900 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzcng"] Jul 07 15:30:01.859530 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:30:01.859497 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde760232_606f_4823_b39c_a721368b2211.slice/crio-a8e6c39dcaf3f1de02c22d1d6c1267d51f056b168168ade320801648cdfc509c WatchSource:0}: Error finding container a8e6c39dcaf3f1de02c22d1d6c1267d51f056b168168ade320801648cdfc509c: Status 404 returned error can't find the container with id a8e6c39dcaf3f1de02c22d1d6c1267d51f056b168168ade320801648cdfc509c Jul 07 15:30:02.069108 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.068994 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:02.069108 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:02.069102 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 15:30:02.069318 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:02.069115 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d797cb784-4gjh6: secret "image-registry-tls" not found Jul 07 15:30:02.069318 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:02.069186 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls podName:5020ec8c-a735-4ff6-a6d0-5e6a78c77463 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:03.069172195 +0000 UTC m=+36.491891407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls") pod "image-registry-6d797cb784-4gjh6" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463") : secret "image-registry-tls" not found Jul 07 15:30:02.154289 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.154235 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:30:02.154289 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.154285 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:30:02.154531 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.154287 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:30:02.157246 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.157228 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gdm6d\"" Jul 07 15:30:02.157373 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.157255 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:30:02.158147 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.158113 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:30:02.158147 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.158137 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:30:02.158147 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.158137 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pzwr\"" Jul 07 15:30:02.158459 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.158447 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:30:02.169343 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.169324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:02.169445 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:02.169425 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:30:02.169500 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:02.169473 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls podName:96351fd9-45ad-49b7-91da-f4a9df652546 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:03.169458741 +0000 UTC m=+36.592177953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls") pod "dns-default-lhggt" (UID: "96351fd9-45ad-49b7-91da-f4a9df652546") : secret "dns-default-metrics-tls" not found Jul 07 15:30:02.328387 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:02.328298 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzcng" event={"ID":"de760232-606f-4823-b39c-a721368b2211","Type":"ContainerStarted","Data":"a8e6c39dcaf3f1de02c22d1d6c1267d51f056b168168ade320801648cdfc509c"} Jul 07 15:30:03.077005 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:03.076964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:03.077402 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:03.077139 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 15:30:03.077402 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:03.077161 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d797cb784-4gjh6: secret "image-registry-tls" not found Jul 07 15:30:03.077402 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:03.077222 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls podName:5020ec8c-a735-4ff6-a6d0-5e6a78c77463 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:05.077203757 +0000 UTC m=+38.499922989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls") pod "image-registry-6d797cb784-4gjh6" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463") : secret "image-registry-tls" not found Jul 07 15:30:03.178188 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:03.178089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:03.178512 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:03.178259 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:30:03.178512 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:03.178338 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls podName:96351fd9-45ad-49b7-91da-f4a9df652546 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:05.17831826 +0000 UTC m=+38.601037472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls") pod "dns-default-lhggt" (UID: "96351fd9-45ad-49b7-91da-f4a9df652546") : secret "dns-default-metrics-tls" not found Jul 07 15:30:04.395003 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:04.394964 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:04.511113 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:04.511075 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:04.769327 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:04.769237 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:05.093474 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:05.093443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:05.093751 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:05.093598 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 15:30:05.093751 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:05.093613 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d797cb784-4gjh6: secret "image-registry-tls" not found Jul 07 15:30:05.093751 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:05.093666 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls podName:5020ec8c-a735-4ff6-a6d0-5e6a78c77463 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:09.093651175 +0000 UTC m=+42.516370401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls") pod "image-registry-6d797cb784-4gjh6" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463") : secret "image-registry-tls" not found Jul 07 15:30:05.094190 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:05.094161 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:05.194729 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:05.194696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:05.194925 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:05.194889 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:30:05.194988 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:05.194948 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls podName:96351fd9-45ad-49b7-91da-f4a9df652546 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:09.194932107 +0000 UTC m=+42.617651511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls") pod "dns-default-lhggt" (UID: "96351fd9-45ad-49b7-91da-f4a9df652546") : secret "dns-default-metrics-tls" not found Jul 07 15:30:05.222095 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:05.222045 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:05.291252 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:05.291218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:05.401930 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:05.401847 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:05.476752 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:05.476709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:05.584817 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:05.584783 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:06.198685 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:06.198651 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:06.276094 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:06.276047 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:06.339912 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:06.339691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzcng" event={"ID":"de760232-606f-4823-b39c-a721368b2211","Type":"ContainerStarted","Data":"8b871291bc8a3cc7dff4cef03479494ae7e539afea8e4c8bb8ac32202c847a4b"} Jul 07 15:30:06.360093 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:06.360027 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xzcng" podStartSLOduration=1.767105165 podStartE2EDuration="5.360006888s" totalImagesPullingTime="3.592901723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:06.35851358 +0000 UTC m=+39.781232815" watchObservedRunningTime="2026-07-07 15:30:06.360006888 +0000 UTC m=+39.782726123" Jul 07 15:30:06.484221 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:06.484062 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:06.599229 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:06.599196 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:07.957641 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:07.957597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:09.128694 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:09.128658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:09.129076 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:09.128786 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 15:30:09.129076 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:09.128798 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d797cb784-4gjh6: secret "image-registry-tls" not found Jul 07 15:30:09.129076 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:09.128850 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls podName:5020ec8c-a735-4ff6-a6d0-5e6a78c77463 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:17.128835254 +0000 UTC m=+50.551554465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls") pod "image-registry-6d797cb784-4gjh6" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463") : secret "image-registry-tls" not found Jul 07 15:30:09.229956 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:09.229920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:09.230232 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:09.230068 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:30:09.230232 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:09.230157 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls podName:96351fd9-45ad-49b7-91da-f4a9df652546 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:17.230138261 +0000 UTC m=+50.652857487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls") pod "dns-default-lhggt" (UID: "96351fd9-45ad-49b7-91da-f4a9df652546") : secret "dns-default-metrics-tls" not found Jul 07 15:30:09.349113 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:09.349079 2561 generic.go:356] "Generic (PLEG): container finished" podID="05ea45eb-026f-49f0-9ebb-f60175c8d22a" containerID="170ba7aa5526d6b73f38d237817e0dafb81637d97c7d03f9555c1a9abc434a9b" exitCode=0 Jul 07 15:30:09.349273 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:09.349164 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" event={"ID":"05ea45eb-026f-49f0-9ebb-f60175c8d22a","Type":"ContainerDied","Data":"170ba7aa5526d6b73f38d237817e0dafb81637d97c7d03f9555c1a9abc434a9b"} Jul 07 15:30:09.430933 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:09.430883 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:10.353673 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:10.353645 2561 generic.go:356] "Generic (PLEG): container finished" podID="05ea45eb-026f-49f0-9ebb-f60175c8d22a" containerID="79ae6c8a2b2e6ccd9097458cb1b765eb3eb65dc38840e1ca858acb3341fa3493" exitCode=0 Jul 07 15:30:10.354026 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:10.353692 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" event={"ID":"05ea45eb-026f-49f0-9ebb-f60175c8d22a","Type":"ContainerDied","Data":"79ae6c8a2b2e6ccd9097458cb1b765eb3eb65dc38840e1ca858acb3341fa3493"} Jul 07 15:30:11.362347 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:11.362313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" event={"ID":"05ea45eb-026f-49f0-9ebb-f60175c8d22a","Type":"ContainerStarted","Data":"93240a699874b8c09d096af27c9192b6417e1f8be2319a602f73b1eee687fdc4"} Jul 07 15:30:11.399583 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:11.399534 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jq5hb" podStartSLOduration=14.39331846 podStartE2EDuration="43.399519141s" totalImagesPullingTime="29.006200681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:11.399185069 +0000 UTC m=+44.821904302" watchObservedRunningTime="2026-07-07 15:30:11.399519141 +0000 UTC m=+44.822238375" Jul 07 15:30:11.530619 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:11.530588 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:11.632169 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:11.632048 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:11.733280 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:11.733219 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:12.367092 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:12.367057 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:12.437825 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:12.437792 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:17.192718 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:17.192671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:17.193109 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:17.192821 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 15:30:17.193109 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:17.192841 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d797cb784-4gjh6: secret "image-registry-tls" not found Jul 07 15:30:17.193109 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:17.192912 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls podName:5020ec8c-a735-4ff6-a6d0-5e6a78c77463 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:33.192895336 +0000 UTC m=+66.615614547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls") pod "image-registry-6d797cb784-4gjh6" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463") : secret "image-registry-tls" not found Jul 07 15:30:17.293435 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:17.293394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:17.293588 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:17.293564 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:30:17.293659 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:17.293649 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls podName:96351fd9-45ad-49b7-91da-f4a9df652546 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:33.293631193 +0000 UTC m=+66.716350409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls") pod "dns-default-lhggt" (UID: "96351fd9-45ad-49b7-91da-f4a9df652546") : secret "dns-default-metrics-tls" not found Jul 07 15:30:27.890636 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:27.890597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:27.953672 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:27.953633 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:28.022973 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:28.022936 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:28.494472 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:28.494444 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8smmh" Jul 07 15:30:28.671602 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:28.671574 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:28.746408 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:28.746315 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:32.798908 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:32.798864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:30:32.799320 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:32.798965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:30:32.803915 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:32.803894 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:30:32.803966 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:32.803903 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:30:32.809081 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:32.809056 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 15:30:32.809167 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:32.809153 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs podName:dbd0a65c-3da5-4f09-b99d-2551a7e33c93 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:36.809133746 +0000 UTC m=+130.231852962 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs") pod "network-metrics-daemon-bnnp4" (UID: "dbd0a65c-3da5-4f09-b99d-2551a7e33c93") : secret "metrics-daemon-secret" not found Jul 07 15:30:32.813010 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:32.812990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03c89f85-a9fe-4ac3-beab-8c51f067a9da-original-pull-secret\") pod \"global-pull-secret-syncer-xfktn\" (UID: \"03c89f85-a9fe-4ac3-beab-8c51f067a9da\") " pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:30:32.899624 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:32.899589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:30:32.902700 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:32.902683 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:30:32.912596 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:32.912575 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:30:32.923544 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:32.923516 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jswp\" (UniqueName: \"kubernetes.io/projected/a9ff7c83-4f17-49d0-9601-31e2372bf3d5-kube-api-access-8jswp\") pod \"network-check-target-qc9dm\" (UID: \"a9ff7c83-4f17-49d0-9601-31e2372bf3d5\") " pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:30:33.065015 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:33.064910 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfktn" Jul 07 15:30:33.077191 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:33.077159 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gdm6d\"" Jul 07 15:30:33.084841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:33.084813 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:30:33.197894 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:33.197862 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfktn"] Jul 07 15:30:33.200376 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:30:33.200342 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c89f85_a9fe_4ac3_beab_8c51f067a9da.slice/crio-63f63e98117108808c0d78ce829f5107e5dfff932e7f9ac47709a11e044e8021 WatchSource:0}: Error finding container 63f63e98117108808c0d78ce829f5107e5dfff932e7f9ac47709a11e044e8021: Status 404 returned error can't find the container with id 63f63e98117108808c0d78ce829f5107e5dfff932e7f9ac47709a11e044e8021 Jul 07 15:30:33.201817 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:33.201695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:30:33.201870 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:33.201819 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 15:30:33.201870 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:33.201833 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d797cb784-4gjh6: secret "image-registry-tls" not found Jul 07 15:30:33.202015 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:33.201893 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls podName:5020ec8c-a735-4ff6-a6d0-5e6a78c77463 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:05.201875657 +0000 UTC m=+98.624594892 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls") pod "image-registry-6d797cb784-4gjh6" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463") : secret "image-registry-tls" not found Jul 07 15:30:33.218777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:33.218756 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qc9dm"] Jul 07 15:30:33.221330 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:30:33.221309 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ff7c83_4f17_49d0_9601_31e2372bf3d5.slice/crio-07716db0ff122336cf93ed46bef3f94258d8f148e2f60fb2c8f8666790878fe9 WatchSource:0}: Error finding container 07716db0ff122336cf93ed46bef3f94258d8f148e2f60fb2c8f8666790878fe9: Status 404 returned error can't find the container with id 07716db0ff122336cf93ed46bef3f94258d8f148e2f60fb2c8f8666790878fe9 Jul 07 15:30:33.303003 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:33.302967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:30:33.303186 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:33.303138 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:30:33.303235 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:33.303210 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls podName:96351fd9-45ad-49b7-91da-f4a9df652546 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:05.303190621 +0000 UTC m=+98.725909843 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls") pod "dns-default-lhggt" (UID: "96351fd9-45ad-49b7-91da-f4a9df652546") : secret "dns-default-metrics-tls" not found Jul 07 15:30:33.415076 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:33.415040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfktn" event={"ID":"03c89f85-a9fe-4ac3-beab-8c51f067a9da","Type":"ContainerStarted","Data":"63f63e98117108808c0d78ce829f5107e5dfff932e7f9ac47709a11e044e8021"} Jul 07 15:30:33.416019 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:33.415999 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qc9dm" event={"ID":"a9ff7c83-4f17-49d0-9601-31e2372bf3d5","Type":"ContainerStarted","Data":"07716db0ff122336cf93ed46bef3f94258d8f148e2f60fb2c8f8666790878fe9"} Jul 07 15:30:40.436802 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:40.436760 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfktn" event={"ID":"03c89f85-a9fe-4ac3-beab-8c51f067a9da","Type":"ContainerStarted","Data":"eedad42e339040749e2ee2279b9996ea7949c64b9c87be9085b1b7a7256ee5a8"} Jul 07 15:30:40.441440 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:40.441410 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qc9dm" event={"ID":"a9ff7c83-4f17-49d0-9601-31e2372bf3d5","Type":"ContainerStarted","Data":"0edefe6a6b89315e8b1601a00372783501561b7cb4af5f5d2f3128118baf4593"} Jul 07 15:30:40.441666 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:40.441543 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:30:40.456051 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:40.456008 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xfktn" podStartSLOduration=66.057215926 podStartE2EDuration="1m12.455994406s" totalImagesPullingTime="6.39877848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:40.455647348 +0000 UTC m=+73.878366581" watchObservedRunningTime="2026-07-07 15:30:40.455994406 +0000 UTC m=+73.878713641" Jul 07 15:30:44.437265 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.437211 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qc9dm" podStartSLOduration=70.070277961 podStartE2EDuration="1m16.437193778s" totalImagesPullingTime="6.366915817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:40.479088993 +0000 UTC m=+73.901808227" watchObservedRunningTime="2026-07-07 15:30:44.437193778 +0000 UTC m=+77.859913012" Jul 07 15:30:44.437838 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.437823 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8"] Jul 07 15:30:44.439911 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.439897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:44.450693 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.450671 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 15:30:44.450928 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.450911 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 15:30:44.452623 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.452603 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-59x79\"" Jul 07 15:30:44.459841 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.459821 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8"] Jul 07 15:30:44.481406 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.481372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:44.481563 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.481419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4a265fd8-70c8-45ab-93fa-13534e5341e4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:44.581768 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.581728 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:44.581938 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.581783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4a265fd8-70c8-45ab-93fa-13534e5341e4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:44.581938 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:44.581878 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 15:30:44.582027 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:44.581953 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert podName:4a265fd8-70c8-45ab-93fa-13534e5341e4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:45.08193609 +0000 UTC m=+78.504655304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-tmmp8" (UID: "4a265fd8-70c8-45ab-93fa-13534e5341e4") : secret "networking-console-plugin-cert" not found Jul 07 15:30:44.582390 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.582373 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4a265fd8-70c8-45ab-93fa-13534e5341e4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:44.583873 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.583853 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-5fpqh"] Jul 07 15:30:44.586335 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.586319 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.593450 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.593426 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 15:30:44.594827 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.594807 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m6qbw\"" Jul 07 15:30:44.595962 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.595948 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 15:30:44.597570 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.597556 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 15:30:44.597837 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.597821 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:30:44.599534 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.599514 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 15:30:44.605559 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.605540 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-5fpqh"] Jul 07 15:30:44.648033 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.648004 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-65nf5"] Jul 07 15:30:44.650321 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.650306 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.654216 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.654187 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 15:30:44.654330 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.654220 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 15:30:44.654330 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.654269 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 15:30:44.654810 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.654796 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 15:30:44.655427 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.655409 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-flls7\"" Jul 07 15:30:44.662735 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.662709 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 15:30:44.665365 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.665342 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-65nf5"] Jul 07 15:30:44.682150 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.682267 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682174 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.682267 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-serving-cert\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.682337 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-865qv\" (UniqueName: \"kubernetes.io/projected/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-kube-api-access-865qv\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.682337 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-snapshots\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.682395 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51844869-9022-4c9a-9fda-412007368c4b-serving-cert\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.682395 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682377 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51844869-9022-4c9a-9fda-412007368c4b-trusted-ca\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.682395 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fhq5\" (UniqueName: \"kubernetes.io/projected/51844869-9022-4c9a-9fda-412007368c4b-kube-api-access-9fhq5\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.682526 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-tmp\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.682526 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.682493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51844869-9022-4c9a-9fda-412007368c4b-config\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.783557 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.783557 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.783557 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-serving-cert\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.783811 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-865qv\" (UniqueName: \"kubernetes.io/projected/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-kube-api-access-865qv\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.783811 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-snapshots\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.783811 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783647 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51844869-9022-4c9a-9fda-412007368c4b-serving-cert\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.783811 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51844869-9022-4c9a-9fda-412007368c4b-trusted-ca\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.783811 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fhq5\" (UniqueName: \"kubernetes.io/projected/51844869-9022-4c9a-9fda-412007368c4b-kube-api-access-9fhq5\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.783811 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-tmp\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.783811 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.783792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51844869-9022-4c9a-9fda-412007368c4b-config\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.784309 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.784281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.784804 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.784512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51844869-9022-4c9a-9fda-412007368c4b-config\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.784804 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.784648 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/51844869-9022-4c9a-9fda-412007368c4b-trusted-ca\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.784804 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.784667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.784804 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.784761 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-tmp\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.784999 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.784877 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-snapshots\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.786198 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.786174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51844869-9022-4c9a-9fda-412007368c4b-serving-cert\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.786582 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.786563 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-serving-cert\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.793498 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.793479 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fhq5\" (UniqueName: \"kubernetes.io/projected/51844869-9022-4c9a-9fda-412007368c4b-kube-api-access-9fhq5\") pod \"console-operator-68b757fb67-5fpqh\" (UID: \"51844869-9022-4c9a-9fda-412007368c4b\") " pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.793606 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.793583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-865qv\" (UniqueName: \"kubernetes.io/projected/a7a20ec3-5611-4473-a9ae-1c4cb1b7987a-kube-api-access-865qv\") pod \"insights-operator-5c847dcfc4-65nf5\" (UID: \"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a\") " pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:44.894674 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.894625 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:44.959112 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:44.959081 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" Jul 07 15:30:45.031154 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:45.031102 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-5fpqh"] Jul 07 15:30:45.034613 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:30:45.034550 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51844869_9022_4c9a_9fda_412007368c4b.slice/crio-0695e73fa027b131f8e8e69fc53c65215c65cea5788269c231b519caf96249a4 WatchSource:0}: Error finding container 0695e73fa027b131f8e8e69fc53c65215c65cea5788269c231b519caf96249a4: Status 404 returned error can't find the container with id 0695e73fa027b131f8e8e69fc53c65215c65cea5788269c231b519caf96249a4 Jul 07 15:30:45.085700 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:45.085667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:45.085855 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:45.085780 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 15:30:45.085855 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:45.085834 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert podName:4a265fd8-70c8-45ab-93fa-13534e5341e4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:46.085821214 +0000 UTC m=+79.508540426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-tmmp8" (UID: "4a265fd8-70c8-45ab-93fa-13534e5341e4") : secret "networking-console-plugin-cert" not found Jul 07 15:30:45.090087 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:45.090060 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-65nf5"] Jul 07 15:30:45.093026 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:30:45.093004 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a20ec3_5611_4473_a9ae_1c4cb1b7987a.slice/crio-5eececea919bff6d69082534424c16fa1f9c3940a5760fc8c3f0a2de0030528c WatchSource:0}: Error finding container 5eececea919bff6d69082534424c16fa1f9c3940a5760fc8c3f0a2de0030528c: Status 404 returned error can't find the container with id 5eececea919bff6d69082534424c16fa1f9c3940a5760fc8c3f0a2de0030528c Jul 07 15:30:45.454972 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:45.454936 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" event={"ID":"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a","Type":"ContainerStarted","Data":"5eececea919bff6d69082534424c16fa1f9c3940a5760fc8c3f0a2de0030528c"} Jul 07 15:30:45.456214 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:45.456195 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" event={"ID":"51844869-9022-4c9a-9fda-412007368c4b","Type":"ContainerStarted","Data":"0695e73fa027b131f8e8e69fc53c65215c65cea5788269c231b519caf96249a4"} Jul 07 15:30:46.094558 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:46.094519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:46.094790 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:46.094655 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 15:30:46.094790 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:46.094726 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert podName:4a265fd8-70c8-45ab-93fa-13534e5341e4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:48.094706234 +0000 UTC m=+81.517425466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-tmmp8" (UID: "4a265fd8-70c8-45ab-93fa-13534e5341e4") : secret "networking-console-plugin-cert" not found Jul 07 15:30:48.109676 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:48.109648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:48.109984 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:48.109789 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 15:30:48.109984 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:48.109854 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert podName:4a265fd8-70c8-45ab-93fa-13534e5341e4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:52.109839328 +0000 UTC m=+85.532558543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-tmmp8" (UID: "4a265fd8-70c8-45ab-93fa-13534e5341e4") : secret "networking-console-plugin-cert" not found Jul 07 15:30:48.466216 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:48.466141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" event={"ID":"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a","Type":"ContainerStarted","Data":"cdc279db1f17268765e29d0d0318ad3a714a98942ecc6fb3e3fa3ad179270da1"} Jul 07 15:30:48.467718 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:48.467697 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/0.log" Jul 07 15:30:48.467826 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:48.467734 2561 generic.go:356] "Generic (PLEG): container finished" podID="51844869-9022-4c9a-9fda-412007368c4b" containerID="ba063786815b80364dad18f7bae8afbaf8c3984efe98f169d78c361a89f12696" exitCode=255 Jul 07 15:30:48.467826 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:48.467763 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" event={"ID":"51844869-9022-4c9a-9fda-412007368c4b","Type":"ContainerDied","Data":"ba063786815b80364dad18f7bae8afbaf8c3984efe98f169d78c361a89f12696"} Jul 07 15:30:48.467981 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:48.467966 2561 scope.go:117] "RemoveContainer" containerID="ba063786815b80364dad18f7bae8afbaf8c3984efe98f169d78c361a89f12696" Jul 07 15:30:48.486614 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:48.486572 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" podStartSLOduration=1.519852961 podStartE2EDuration="4.486557418s" totalImagesPullingTime="2.966704457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:48.485226267 +0000 UTC m=+81.907945501" watchObservedRunningTime="2026-07-07 15:30:48.486557418 +0000 UTC m=+81.909276651" Jul 07 15:30:49.472244 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.472211 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:30:49.472686 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.472669 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/0.log" Jul 07 15:30:49.472740 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.472713 2561 generic.go:356] "Generic (PLEG): container finished" podID="51844869-9022-4c9a-9fda-412007368c4b" containerID="e95b6e8b6b088a6db11ea7b04976b07e3b89ae8d79af6a495d2af0f8f3eb1233" exitCode=255 Jul 07 15:30:49.472831 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.472808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" event={"ID":"51844869-9022-4c9a-9fda-412007368c4b","Type":"ContainerDied","Data":"e95b6e8b6b088a6db11ea7b04976b07e3b89ae8d79af6a495d2af0f8f3eb1233"} Jul 07 15:30:49.472874 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.472863 2561 scope.go:117] "RemoveContainer" containerID="ba063786815b80364dad18f7bae8afbaf8c3984efe98f169d78c361a89f12696" Jul 07 15:30:49.473167 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.473147 2561 scope.go:117] "RemoveContainer" containerID="e95b6e8b6b088a6db11ea7b04976b07e3b89ae8d79af6a495d2af0f8f3eb1233" Jul 07 15:30:49.473357 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:49.473335 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-5fpqh_openshift-console-operator(51844869-9022-4c9a-9fda-412007368c4b)\"" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" podUID="51844869-9022-4c9a-9fda-412007368c4b" Jul 07 15:30:49.510331 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.510301 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xtt2b"] Jul 07 15:30:49.513101 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.513081 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.516952 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.516930 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 15:30:49.517280 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.517263 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r642f\"" Jul 07 15:30:49.517280 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.517276 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 15:30:49.542034 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.542007 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xtt2b"] Jul 07 15:30:49.621355 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.621326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqkl6\" (UniqueName: \"kubernetes.io/projected/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-api-access-hqkl6\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.621543 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.621383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d7dedc-8f35-4dca-9a71-918b2f33d798-data-volume\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.621543 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.621461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88d7dedc-8f35-4dca-9a71-918b2f33d798-crio-socket\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.621543 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.621491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.621543 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.621530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.722511 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.722415 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88d7dedc-8f35-4dca-9a71-918b2f33d798-crio-socket\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.722511 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.722457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.722511 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.722489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.722793 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.722544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqkl6\" (UniqueName: \"kubernetes.io/projected/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-api-access-hqkl6\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.722793 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.722556 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88d7dedc-8f35-4dca-9a71-918b2f33d798-crio-socket\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.722793 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:49.722572 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:30:49.722793 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.722606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d7dedc-8f35-4dca-9a71-918b2f33d798-data-volume\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.722793 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:49.722654 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:50.222637718 +0000 UTC m=+83.645356930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : configmap "kube-rbac-proxy" not found Jul 07 15:30:49.722793 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:49.722670 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:30:49.722793 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:49.722717 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:50.222702234 +0000 UTC m=+83.645421449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : secret "insights-runtime-extractor-tls" not found Jul 07 15:30:49.723172 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.722895 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d7dedc-8f35-4dca-9a71-918b2f33d798-data-volume\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:49.736539 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:49.736518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqkl6\" (UniqueName: \"kubernetes.io/projected/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-api-access-hqkl6\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:50.226364 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:50.226321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:50.226559 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:50.226442 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:30:50.226559 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:50.226457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:50.226559 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:50.226500 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:51.226484531 +0000 UTC m=+84.649203744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : secret "insights-runtime-extractor-tls" not found Jul 07 15:30:50.226559 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:50.226534 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:30:50.226724 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:50.226589 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:51.226574389 +0000 UTC m=+84.649293615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : configmap "kube-rbac-proxy" not found Jul 07 15:30:50.476552 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:50.476472 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:30:50.476918 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:50.476772 2561 scope.go:117] "RemoveContainer" containerID="e95b6e8b6b088a6db11ea7b04976b07e3b89ae8d79af6a495d2af0f8f3eb1233" Jul 07 15:30:50.476918 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:50.476908 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-5fpqh_openshift-console-operator(51844869-9022-4c9a-9fda-412007368c4b)\"" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" podUID="51844869-9022-4c9a-9fda-412007368c4b" Jul 07 15:30:51.235114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.235074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:51.235324 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.235186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:51.235324 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:51.235197 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:30:51.235324 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:51.235259 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:53.235243485 +0000 UTC m=+86.657962696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : configmap "kube-rbac-proxy" not found Jul 07 15:30:51.235324 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:51.235312 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:30:51.235461 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:51.235361 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:53.235349045 +0000 UTC m=+86.658068257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : secret "insights-runtime-extractor-tls" not found Jul 07 15:30:51.553618 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.553542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bs9m_c8108322-2c7b-4153-a665-853cabc0ab11/dns-node-resolver/0.log" Jul 07 15:30:51.871718 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.871685 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b"] Jul 07 15:30:51.875000 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.874981 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" Jul 07 15:30:51.879195 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.879174 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 15:30:51.879495 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.879465 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-db892\"" Jul 07 15:30:51.879582 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.879474 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 15:30:51.879582 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.879475 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 15:30:51.880389 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.880365 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 15:30:51.890352 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.890322 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll"] Jul 07 15:30:51.892315 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.892298 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b"] Jul 07 15:30:51.892395 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.892376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:51.894824 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.894805 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 15:30:51.907322 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.907303 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll"] Jul 07 15:30:51.941342 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.941309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/016e49a8-4baf-4bb8-80d1-21132fed7113-klusterlet-config\") pod \"klusterlet-addon-workmgr-844fd79948-fmlll\" (UID: \"016e49a8-4baf-4bb8-80d1-21132fed7113\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:51.941499 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.941362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6t6n\" (UniqueName: \"kubernetes.io/projected/45ecd676-a9e3-4e45-8413-db303f7082c5-kube-api-access-k6t6n\") pod \"managed-serviceaccount-addon-agent-7778bf4858-qrk9b\" (UID: \"45ecd676-a9e3-4e45-8413-db303f7082c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" Jul 07 15:30:51.941499 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.941437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45ecd676-a9e3-4e45-8413-db303f7082c5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7778bf4858-qrk9b\" (UID: \"45ecd676-a9e3-4e45-8413-db303f7082c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" Jul 07 15:30:51.941499 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.941470 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bvp8\" (UniqueName: \"kubernetes.io/projected/016e49a8-4baf-4bb8-80d1-21132fed7113-kube-api-access-2bvp8\") pod \"klusterlet-addon-workmgr-844fd79948-fmlll\" (UID: \"016e49a8-4baf-4bb8-80d1-21132fed7113\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:51.941499 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:51.941496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/016e49a8-4baf-4bb8-80d1-21132fed7113-tmp\") pod \"klusterlet-addon-workmgr-844fd79948-fmlll\" (UID: \"016e49a8-4baf-4bb8-80d1-21132fed7113\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:52.042593 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.042554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45ecd676-a9e3-4e45-8413-db303f7082c5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7778bf4858-qrk9b\" (UID: \"45ecd676-a9e3-4e45-8413-db303f7082c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" Jul 07 15:30:52.042850 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.042611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bvp8\" (UniqueName: \"kubernetes.io/projected/016e49a8-4baf-4bb8-80d1-21132fed7113-kube-api-access-2bvp8\") pod \"klusterlet-addon-workmgr-844fd79948-fmlll\" (UID: \"016e49a8-4baf-4bb8-80d1-21132fed7113\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:52.042850 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.042647 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/016e49a8-4baf-4bb8-80d1-21132fed7113-tmp\") pod \"klusterlet-addon-workmgr-844fd79948-fmlll\" (UID: \"016e49a8-4baf-4bb8-80d1-21132fed7113\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:52.042850 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.042706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/016e49a8-4baf-4bb8-80d1-21132fed7113-klusterlet-config\") pod \"klusterlet-addon-workmgr-844fd79948-fmlll\" (UID: \"016e49a8-4baf-4bb8-80d1-21132fed7113\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:52.042850 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.042757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6t6n\" (UniqueName: \"kubernetes.io/projected/45ecd676-a9e3-4e45-8413-db303f7082c5-kube-api-access-k6t6n\") pod \"managed-serviceaccount-addon-agent-7778bf4858-qrk9b\" (UID: \"45ecd676-a9e3-4e45-8413-db303f7082c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" Jul 07 15:30:52.043180 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.043142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/016e49a8-4baf-4bb8-80d1-21132fed7113-tmp\") pod \"klusterlet-addon-workmgr-844fd79948-fmlll\" (UID: \"016e49a8-4baf-4bb8-80d1-21132fed7113\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:52.045301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.045276 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/016e49a8-4baf-4bb8-80d1-21132fed7113-klusterlet-config\") pod \"klusterlet-addon-workmgr-844fd79948-fmlll\" (UID: \"016e49a8-4baf-4bb8-80d1-21132fed7113\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:52.045382 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.045299 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45ecd676-a9e3-4e45-8413-db303f7082c5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7778bf4858-qrk9b\" (UID: \"45ecd676-a9e3-4e45-8413-db303f7082c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" Jul 07 15:30:52.053517 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.053492 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6t6n\" (UniqueName: \"kubernetes.io/projected/45ecd676-a9e3-4e45-8413-db303f7082c5-kube-api-access-k6t6n\") pod \"managed-serviceaccount-addon-agent-7778bf4858-qrk9b\" (UID: \"45ecd676-a9e3-4e45-8413-db303f7082c5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" Jul 07 15:30:52.053973 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.053952 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bvp8\" (UniqueName: \"kubernetes.io/projected/016e49a8-4baf-4bb8-80d1-21132fed7113-kube-api-access-2bvp8\") pod \"klusterlet-addon-workmgr-844fd79948-fmlll\" (UID: \"016e49a8-4baf-4bb8-80d1-21132fed7113\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:52.143769 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.143679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:30:52.143907 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:52.143812 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 15:30:52.143907 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:52.143888 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert podName:4a265fd8-70c8-45ab-93fa-13534e5341e4 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:00.143871883 +0000 UTC m=+93.566591095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-tmmp8" (UID: "4a265fd8-70c8-45ab-93fa-13534e5341e4") : secret "networking-console-plugin-cert" not found Jul 07 15:30:52.193680 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.193641 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" Jul 07 15:30:52.201008 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.200987 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:30:52.330405 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.330377 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b"] Jul 07 15:30:52.332369 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:30:52.332348 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45ecd676_a9e3_4e45_8413_db303f7082c5.slice/crio-e3c10c9e577af5e45060e1c4dbab2641a1b9d47daecd02c371dee5e6c2ef6bae WatchSource:0}: Error finding container e3c10c9e577af5e45060e1c4dbab2641a1b9d47daecd02c371dee5e6c2ef6bae: Status 404 returned error can't find the container with id e3c10c9e577af5e45060e1c4dbab2641a1b9d47daecd02c371dee5e6c2ef6bae Jul 07 15:30:52.343539 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.343515 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll"] Jul 07 15:30:52.345597 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:30:52.345574 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016e49a8_4baf_4bb8_80d1_21132fed7113.slice/crio-784ad718f5b1e90f30527eea4207e69ac543131ee03968676a9f30b605aaecf7 WatchSource:0}: Error finding container 784ad718f5b1e90f30527eea4207e69ac543131ee03968676a9f30b605aaecf7: Status 404 returned error can't find the container with id 784ad718f5b1e90f30527eea4207e69ac543131ee03968676a9f30b605aaecf7 Jul 07 15:30:52.483189 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.483083 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" event={"ID":"016e49a8-4baf-4bb8-80d1-21132fed7113","Type":"ContainerStarted","Data":"784ad718f5b1e90f30527eea4207e69ac543131ee03968676a9f30b605aaecf7"} Jul 07 15:30:52.485752 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.485718 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" event={"ID":"45ecd676-a9e3-4e45-8413-db303f7082c5","Type":"ContainerStarted","Data":"e3c10c9e577af5e45060e1c4dbab2641a1b9d47daecd02c371dee5e6c2ef6bae"} Jul 07 15:30:52.551844 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:52.551813 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxhl9_151a5f06-a785-4283-861c-1ddf2eea2d55/node-ca/0.log" Jul 07 15:30:53.254108 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:53.254077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:53.254488 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:53.254143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:53.254488 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:53.254208 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:30:53.254488 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:53.254238 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:30:53.254488 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:53.254278 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:57.254264841 +0000 UTC m=+90.676984055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : secret "insights-runtime-extractor-tls" not found Jul 07 15:30:53.254488 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:53.254293 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:57.254286246 +0000 UTC m=+90.677005462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : configmap "kube-rbac-proxy" not found Jul 07 15:30:53.568211 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:53.568102 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzcng_de760232-606f-4823-b39c-a721368b2211/serve-healthcheck-canary/0.log" Jul 07 15:30:54.895348 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:54.895311 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:54.895810 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:54.895400 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:30:54.895810 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:54.895754 2561 scope.go:117] "RemoveContainer" containerID="e95b6e8b6b088a6db11ea7b04976b07e3b89ae8d79af6a495d2af0f8f3eb1233" Jul 07 15:30:54.895947 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:54.895926 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-5fpqh_openshift-console-operator(51844869-9022-4c9a-9fda-412007368c4b)\"" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" podUID="51844869-9022-4c9a-9fda-412007368c4b" Jul 07 15:30:55.497872 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:55.497830 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" event={"ID":"45ecd676-a9e3-4e45-8413-db303f7082c5","Type":"ContainerStarted","Data":"7e775bb438a8bebba168deee4d926587565c33bd07d07fae8d50af3dbcd210a4"} Jul 07 15:30:55.520235 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:55.520180 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7778bf4858-qrk9b" podStartSLOduration=1.414736679 podStartE2EDuration="4.520150716s" totalImagesPullingTime="3.105414037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:55.5195788 +0000 UTC m=+88.942298035" watchObservedRunningTime="2026-07-07 15:30:55.520150716 +0000 UTC m=+88.942869946" Jul 07 15:30:57.291663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:57.291611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:57.292110 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:30:57.291691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:30:57.292110 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:57.291733 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:30:57.292110 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:57.291795 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:05.291778721 +0000 UTC m=+98.714497936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : configmap "kube-rbac-proxy" not found Jul 07 15:30:57.292110 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:57.291879 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:30:57.292110 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:30:57.291949 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:05.291932575 +0000 UTC m=+98.714651786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : secret "insights-runtime-extractor-tls" not found Jul 07 15:31:00.213421 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:00.213375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:31:00.213938 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:31:00.213552 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 15:31:00.213938 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:31:00.213638 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert podName:4a265fd8-70c8-45ab-93fa-13534e5341e4 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:16.213617232 +0000 UTC m=+109.636336452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-tmmp8" (UID: "4a265fd8-70c8-45ab-93fa-13534e5341e4") : secret "networking-console-plugin-cert" not found Jul 07 15:31:05.257531 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.257497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:31:05.260025 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.260006 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"image-registry-6d797cb784-4gjh6\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:31:05.299993 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.299959 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wwv9f\"" Jul 07 15:31:05.307925 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.307898 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:31:05.358824 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.358797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:31:05.358985 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.358873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:31:05.358985 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.358949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:31:05.359481 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.359460 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d7dedc-8f35-4dca-9a71-918b2f33d798-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:31:05.359601 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:31:05.359580 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:31:05.359662 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:31:05.359655 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls podName:88d7dedc-8f35-4dca-9a71-918b2f33d798 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:21.359636428 +0000 UTC m=+114.782355654 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xtt2b" (UID: "88d7dedc-8f35-4dca-9a71-918b2f33d798") : secret "insights-runtime-extractor-tls" not found Jul 07 15:31:05.362442 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.362410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96351fd9-45ad-49b7-91da-f4a9df652546-metrics-tls\") pod \"dns-default-lhggt\" (UID: \"96351fd9-45ad-49b7-91da-f4a9df652546\") " pod="openshift-dns/dns-default-lhggt" Jul 07 15:31:05.445967 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.445936 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d797cb784-4gjh6"] Jul 07 15:31:05.449079 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:05.449050 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5020ec8c_a735_4ff6_a6d0_5e6a78c77463.slice/crio-3bfa465b9b856785c2fb17e947befe996dce1f35ce94583b0f9da1543e13e440 WatchSource:0}: Error finding container 3bfa465b9b856785c2fb17e947befe996dce1f35ce94583b0f9da1543e13e440: Status 404 returned error can't find the container with id 3bfa465b9b856785c2fb17e947befe996dce1f35ce94583b0f9da1543e13e440 Jul 07 15:31:05.533225 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.533141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" event={"ID":"5020ec8c-a735-4ff6-a6d0-5e6a78c77463","Type":"ContainerStarted","Data":"891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab"} Jul 07 15:31:05.533225 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.533189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" event={"ID":"5020ec8c-a735-4ff6-a6d0-5e6a78c77463","Type":"ContainerStarted","Data":"3bfa465b9b856785c2fb17e947befe996dce1f35ce94583b0f9da1543e13e440"} Jul 07 15:31:05.533423 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.533245 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:31:05.585143 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.585071 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" podStartSLOduration=97.585056191 podStartE2EDuration="1m37.585056191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:05.58480967 +0000 UTC m=+99.007528904" watchObservedRunningTime="2026-07-07 15:31:05.585056191 +0000 UTC m=+99.007775426" Jul 07 15:31:05.616782 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.616752 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5x8h\"" Jul 07 15:31:05.622381 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.622351 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhggt" Jul 07 15:31:05.772809 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:05.772646 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lhggt"] Jul 07 15:31:05.775372 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:05.775350 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96351fd9_45ad_49b7_91da_f4a9df652546.slice/crio-e76fe4f3fcc617a52ebb600f188e2d272f4c19d3d9f3b448ac73931618f2c56e WatchSource:0}: Error finding container e76fe4f3fcc617a52ebb600f188e2d272f4c19d3d9f3b448ac73931618f2c56e: Status 404 returned error can't find the container with id e76fe4f3fcc617a52ebb600f188e2d272f4c19d3d9f3b448ac73931618f2c56e Jul 07 15:31:06.538585 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:06.538487 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lhggt" event={"ID":"96351fd9-45ad-49b7-91da-f4a9df652546","Type":"ContainerStarted","Data":"e76fe4f3fcc617a52ebb600f188e2d272f4c19d3d9f3b448ac73931618f2c56e"} Jul 07 15:31:09.159704 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:09.159678 2561 scope.go:117] "RemoveContainer" containerID="e95b6e8b6b088a6db11ea7b04976b07e3b89ae8d79af6a495d2af0f8f3eb1233" Jul 07 15:31:09.550959 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:09.550859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lhggt" event={"ID":"96351fd9-45ad-49b7-91da-f4a9df652546","Type":"ContainerStarted","Data":"71b2a7f69607b8642f45152b71ed80248e6dbc81150ccbb33385e67629a53ac3"} Jul 07 15:31:10.555769 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.555730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lhggt" event={"ID":"96351fd9-45ad-49b7-91da-f4a9df652546","Type":"ContainerStarted","Data":"4aa8fc056f7273299331141ddbe435451d5202b31d6e6bae2cf0477a05987944"} Jul 07 15:31:10.556270 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.555824 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lhggt" Jul 07 15:31:10.557340 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.557310 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" event={"ID":"016e49a8-4baf-4bb8-80d1-21132fed7113","Type":"ContainerStarted","Data":"623c02794bc316004559b8623b1ad547d4f66b39fd3a6fb2e4c5daeaf700313c"} Jul 07 15:31:10.557516 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.557501 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:31:10.559251 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.559227 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:31:10.559357 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.559290 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" event={"ID":"51844869-9022-4c9a-9fda-412007368c4b","Type":"ContainerStarted","Data":"761168c2fde927fd9d71563106810d31631797e318e37b61b80df3019ffaecc9"} Jul 07 15:31:10.559420 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.559403 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" Jul 07 15:31:10.577635 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.577589 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lhggt" podStartSLOduration=66.620785688 podStartE2EDuration="1m9.577575427s" totalImagesPullingTime="2.956789739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:10.576210971 +0000 UTC m=+103.998930206" watchObservedRunningTime="2026-07-07 15:31:10.577575427 +0000 UTC m=+104.000294660" Jul 07 15:31:10.594230 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.594178 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" podStartSLOduration=23.569919167 podStartE2EDuration="26.594165766s" totalImagesPullingTime="3.024246599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:10.594156869 +0000 UTC m=+104.016876103" watchObservedRunningTime="2026-07-07 15:31:10.594165766 +0000 UTC m=+104.016885000" Jul 07 15:31:10.612143 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:10.612082 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-844fd79948-fmlll" podStartSLOduration=1.559194356 podStartE2EDuration="19.612062275s" totalImagesPullingTime="18.052867919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:10.611679685 +0000 UTC m=+104.034398919" watchObservedRunningTime="2026-07-07 15:31:10.612062275 +0000 UTC m=+104.034781506" Jul 07 15:31:11.447033 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:11.446995 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qc9dm" Jul 07 15:31:16.255549 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:16.255507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:31:16.258232 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:16.258206 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a265fd8-70c8-45ab-93fa-13534e5341e4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tmmp8\" (UID: \"4a265fd8-70c8-45ab-93fa-13534e5341e4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:31:16.548923 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:16.548835 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" Jul 07 15:31:16.694572 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:16.694537 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8"] Jul 07 15:31:16.697783 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:16.697755 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a265fd8_70c8_45ab_93fa_13534e5341e4.slice/crio-5ac9c99d33e0d6a22fe9a79dab10b8fd3f5f1bd27d1c4187888c4c2361c1bdf9 WatchSource:0}: Error finding container 5ac9c99d33e0d6a22fe9a79dab10b8fd3f5f1bd27d1c4187888c4c2361c1bdf9: Status 404 returned error can't find the container with id 5ac9c99d33e0d6a22fe9a79dab10b8fd3f5f1bd27d1c4187888c4c2361c1bdf9 Jul 07 15:31:17.581908 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:17.581869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" event={"ID":"4a265fd8-70c8-45ab-93fa-13534e5341e4","Type":"ContainerStarted","Data":"5ac9c99d33e0d6a22fe9a79dab10b8fd3f5f1bd27d1c4187888c4c2361c1bdf9"} Jul 07 15:31:18.587303 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:18.587256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" event={"ID":"4a265fd8-70c8-45ab-93fa-13534e5341e4","Type":"ContainerStarted","Data":"5f5c7935ea381bda52a7176e7d02faf7f140a1da6b4243269bfe7fb5ebc21852"} Jul 07 15:31:18.621950 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:18.621895 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tmmp8" podStartSLOduration=33.294954255 podStartE2EDuration="34.621875141s" totalImagesPullingTime="1.326920886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:18.621192199 +0000 UTC m=+112.043911432" watchObservedRunningTime="2026-07-07 15:31:18.621875141 +0000 UTC m=+112.044594373" Jul 07 15:31:20.560299 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:20.560264 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:31:20.564016 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:20.563990 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-5fpqh" Jul 07 15:31:20.564465 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:20.564446 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lhggt" Jul 07 15:31:21.392317 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:21.392264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:31:21.394760 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:21.394734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d7dedc-8f35-4dca-9a71-918b2f33d798-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xtt2b\" (UID: \"88d7dedc-8f35-4dca-9a71-918b2f33d798\") " pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:31:21.623176 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:21.623115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xtt2b" Jul 07 15:31:21.762009 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:21.761837 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xtt2b"] Jul 07 15:31:21.764507 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:21.764482 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d7dedc_8f35_4dca_9a71_918b2f33d798.slice/crio-d08bb4d783e56f87604ccb236f96010c38cc9690f69fa95a5c8c3580960ecdf8 WatchSource:0}: Error finding container d08bb4d783e56f87604ccb236f96010c38cc9690f69fa95a5c8c3580960ecdf8: Status 404 returned error can't find the container with id d08bb4d783e56f87604ccb236f96010c38cc9690f69fa95a5c8c3580960ecdf8 Jul 07 15:31:22.605819 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:22.605780 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xtt2b" event={"ID":"88d7dedc-8f35-4dca-9a71-918b2f33d798","Type":"ContainerStarted","Data":"d08bb4d783e56f87604ccb236f96010c38cc9690f69fa95a5c8c3580960ecdf8"} Jul 07 15:31:25.312821 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:25.312783 2561 patch_prober.go:28] interesting pod/image-registry-6d797cb784-4gjh6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 15:31:25.313206 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:25.312847 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" podUID="5020ec8c-a735-4ff6-a6d0-5e6a78c77463" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:31:26.546099 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:26.546062 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:31:26.621309 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:26.621272 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xtt2b" event={"ID":"88d7dedc-8f35-4dca-9a71-918b2f33d798","Type":"ContainerStarted","Data":"1530969274f49904744a62b28854e867f7496ce19d8e4d6f5097819a30c66f3e"} Jul 07 15:31:27.627028 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:27.626986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xtt2b" event={"ID":"88d7dedc-8f35-4dca-9a71-918b2f33d798","Type":"ContainerStarted","Data":"dd9e2a3810bc025de78e02969bd68cdabe2fa859bee64c5b622b50771bac39a8"} Jul 07 15:31:29.635905 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:29.635869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xtt2b" event={"ID":"88d7dedc-8f35-4dca-9a71-918b2f33d798","Type":"ContainerStarted","Data":"a5fd824a9b3cd33d1baf833721ebc92c8df7fc2417e36d914117cd086ff66e4d"} Jul 07 15:31:29.662411 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:29.662367 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xtt2b" podStartSLOduration=33.478787762 podStartE2EDuration="40.662351905s" totalImagesPullingTime="7.183564143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:29.662138748 +0000 UTC m=+123.084857982" watchObservedRunningTime="2026-07-07 15:31:29.662351905 +0000 UTC m=+123.085071138" Jul 07 15:31:31.456313 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.456277 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547"] Jul 07 15:31:31.458571 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.458553 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.461013 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.460993 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 15:31:31.462339 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.462317 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-c9ltq\"" Jul 07 15:31:31.462958 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.462941 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 15:31:31.463019 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.462980 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 15:31:31.463482 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.463469 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 15:31:31.466659 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.466637 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 15:31:31.479866 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.479838 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547"] Jul 07 15:31:31.539870 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.539843 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ss2nv"] Jul 07 15:31:31.542192 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.542176 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.544885 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.544860 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 15:31:31.545435 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.545414 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 15:31:31.545522 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.545421 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 15:31:31.546269 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.546246 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k8qcf\"" Jul 07 15:31:31.572417 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.572593 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.572593 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572456 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-textfile\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.572593 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bb3648c-6523-4c71-a46d-12307b1bba1a-root\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.572593 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572581 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-wtmp\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.572798 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.572798 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.572895 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.572895 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbwlj\" (UniqueName: \"kubernetes.io/projected/4bb3648c-6523-4c71-a46d-12307b1bba1a-kube-api-access-fbwlj\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.572990 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bb3648c-6523-4c71-a46d-12307b1bba1a-sys\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.572990 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572944 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw8c5\" (UniqueName: \"kubernetes.io/projected/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-kube-api-access-xw8c5\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.573071 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.572987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-tls\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.573071 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.573010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bb3648c-6523-4c71-a46d-12307b1bba1a-metrics-client-ca\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.673380 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-textfile\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.673380 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bb3648c-6523-4c71-a46d-12307b1bba1a-root\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.673605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-wtmp\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.673605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.673605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673450 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.673605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.673605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bb3648c-6523-4c71-a46d-12307b1bba1a-root\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.673605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbwlj\" (UniqueName: \"kubernetes.io/projected/4bb3648c-6523-4c71-a46d-12307b1bba1a-kube-api-access-fbwlj\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.673605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bb3648c-6523-4c71-a46d-12307b1bba1a-sys\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.673605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673539 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-wtmp\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.673605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw8c5\" (UniqueName: \"kubernetes.io/projected/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-kube-api-access-xw8c5\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.674047 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673617 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-tls\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.674047 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673644 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bb3648c-6523-4c71-a46d-12307b1bba1a-sys\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.674047 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bb3648c-6523-4c71-a46d-12307b1bba1a-metrics-client-ca\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.674047 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673703 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.674047 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673732 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.674047 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.673731 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-textfile\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.674526 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.674230 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.674526 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.674285 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.674526 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.674285 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bb3648c-6523-4c71-a46d-12307b1bba1a-metrics-client-ca\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.676012 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.675994 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.676481 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.676464 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bb3648c-6523-4c71-a46d-12307b1bba1a-node-exporter-tls\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.676568 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.676548 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.676700 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.676675 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.694067 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.694047 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw8c5\" (UniqueName: \"kubernetes.io/projected/94d598b0-cd35-42c4-bbb0-cd8db88ab1da-kube-api-access-xw8c5\") pod \"openshift-state-metrics-54cf96dfcf-dh547\" (UID: \"94d598b0-cd35-42c4-bbb0-cd8db88ab1da\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.694242 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.694222 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbwlj\" (UniqueName: \"kubernetes.io/projected/4bb3648c-6523-4c71-a46d-12307b1bba1a-kube-api-access-fbwlj\") pod \"node-exporter-ss2nv\" (UID: \"4bb3648c-6523-4c71-a46d-12307b1bba1a\") " pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.767238 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.767153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" Jul 07 15:31:31.851461 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.851432 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ss2nv" Jul 07 15:31:31.860905 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:31.860866 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb3648c_6523_4c71_a46d_12307b1bba1a.slice/crio-9d10678fb51c26c2b900b13a718fbd490d9ee17f997a01d71de631da2369f07b WatchSource:0}: Error finding container 9d10678fb51c26c2b900b13a718fbd490d9ee17f997a01d71de631da2369f07b: Status 404 returned error can't find the container with id 9d10678fb51c26c2b900b13a718fbd490d9ee17f997a01d71de631da2369f07b Jul 07 15:31:31.925582 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:31.925558 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547"] Jul 07 15:31:31.927917 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:31.927890 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d598b0_cd35_42c4_bbb0_cd8db88ab1da.slice/crio-2fa938a4a82eb632b19cecaed5ccfa9925ffd66fc64c8c2d47d22ed7de60a76f WatchSource:0}: Error finding container 2fa938a4a82eb632b19cecaed5ccfa9925ffd66fc64c8c2d47d22ed7de60a76f: Status 404 returned error can't find the container with id 2fa938a4a82eb632b19cecaed5ccfa9925ffd66fc64c8c2d47d22ed7de60a76f Jul 07 15:31:32.647632 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.647595 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss2nv" event={"ID":"4bb3648c-6523-4c71-a46d-12307b1bba1a","Type":"ContainerStarted","Data":"9d10678fb51c26c2b900b13a718fbd490d9ee17f997a01d71de631da2369f07b"} Jul 07 15:31:32.649919 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.649894 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" event={"ID":"94d598b0-cd35-42c4-bbb0-cd8db88ab1da","Type":"ContainerStarted","Data":"7437c2f559ef86b75b842c35b679282ef89e8cee397e8dfa86b11c7ac7cb918f"} Jul 07 15:31:32.650038 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.649941 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" event={"ID":"94d598b0-cd35-42c4-bbb0-cd8db88ab1da","Type":"ContainerStarted","Data":"6acfb835c44dd807b14dd9b0740b1faa636a78a67da19602c42134ee0a7c1420"} Jul 07 15:31:32.650038 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.649971 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" event={"ID":"94d598b0-cd35-42c4-bbb0-cd8db88ab1da","Type":"ContainerStarted","Data":"2fa938a4a82eb632b19cecaed5ccfa9925ffd66fc64c8c2d47d22ed7de60a76f"} Jul 07 15:31:32.679225 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.679184 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 15:31:32.683846 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.683819 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.686382 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.686358 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7zb4m\"" Jul 07 15:31:32.688018 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.687800 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 15:31:32.688716 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.688576 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 15:31:32.688716 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.688586 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 15:31:32.688716 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.688602 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 15:31:32.688716 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.688590 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 15:31:32.691698 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.691676 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 15:31:32.692087 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.692069 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 15:31:32.693099 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.693081 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 15:31:32.696349 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.696323 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 15:31:32.706712 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.706687 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 15:31:32.784261 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784225 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8c4d921-feff-49e8-9fd0-0335bfd90666-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784433 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8c4d921-feff-49e8-9fd0-0335bfd90666-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784433 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784334 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784433 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8c4d921-feff-49e8-9fd0-0335bfd90666-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784433 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8c4d921-feff-49e8-9fd0-0335bfd90666-config-out\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784433 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784664 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8c4d921-feff-49e8-9fd0-0335bfd90666-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784664 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784664 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784770 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-web-config\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784770 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns4kv\" (UniqueName: \"kubernetes.io/projected/c8c4d921-feff-49e8-9fd0-0335bfd90666-kube-api-access-ns4kv\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784770 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.784885 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.784789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.885927 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.885891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886136 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.885938 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886136 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.885964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-web-config\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886136 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.885987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns4kv\" (UniqueName: \"kubernetes.io/projected/c8c4d921-feff-49e8-9fd0-0335bfd90666-kube-api-access-ns4kv\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886311 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.886274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886363 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.886326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886421 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.886367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8c4d921-feff-49e8-9fd0-0335bfd90666-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886421 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.886406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8c4d921-feff-49e8-9fd0-0335bfd90666-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886520 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.886442 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886520 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.886474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8c4d921-feff-49e8-9fd0-0335bfd90666-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886520 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.886507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8c4d921-feff-49e8-9fd0-0335bfd90666-config-out\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886659 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.886532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.886659 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.886554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8c4d921-feff-49e8-9fd0-0335bfd90666-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.887079 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.887052 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8c4d921-feff-49e8-9fd0-0335bfd90666-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.887531 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.887370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8c4d921-feff-49e8-9fd0-0335bfd90666-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.887667 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.887644 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8c4d921-feff-49e8-9fd0-0335bfd90666-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.889657 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.889639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.890385 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.890360 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8c4d921-feff-49e8-9fd0-0335bfd90666-config-out\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.890979 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.890935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.891061 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.890985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.891637 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.891599 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.891637 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.891605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-web-config\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.891885 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.891862 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8c4d921-feff-49e8-9fd0-0335bfd90666-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.892201 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.892184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.892434 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.892417 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8c4d921-feff-49e8-9fd0-0335bfd90666-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.898643 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.898593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns4kv\" (UniqueName: \"kubernetes.io/projected/c8c4d921-feff-49e8-9fd0-0335bfd90666-kube-api-access-ns4kv\") pod \"alertmanager-main-0\" (UID: \"c8c4d921-feff-49e8-9fd0-0335bfd90666\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:32.998018 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:32.997975 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:31:33.245439 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:33.245409 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 15:31:33.435619 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:33.435539 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c4d921_feff_49e8_9fd0_0335bfd90666.slice/crio-0b29ccfcc5925874dfecfac9c977d996d0c607f8ef691f78e4898b9fc4d3c7c3 WatchSource:0}: Error finding container 0b29ccfcc5925874dfecfac9c977d996d0c607f8ef691f78e4898b9fc4d3c7c3: Status 404 returned error can't find the container with id 0b29ccfcc5925874dfecfac9c977d996d0c607f8ef691f78e4898b9fc4d3c7c3 Jul 07 15:31:33.655646 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:33.655615 2561 generic.go:356] "Generic (PLEG): container finished" podID="4bb3648c-6523-4c71-a46d-12307b1bba1a" containerID="5b1e647f1d14fd4be12d3143029a982706b25507a97a0162bd50c0d52b24c921" exitCode=0 Jul 07 15:31:33.656093 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:33.655697 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss2nv" event={"ID":"4bb3648c-6523-4c71-a46d-12307b1bba1a","Type":"ContainerDied","Data":"5b1e647f1d14fd4be12d3143029a982706b25507a97a0162bd50c0d52b24c921"} Jul 07 15:31:33.657845 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:33.657824 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" event={"ID":"94d598b0-cd35-42c4-bbb0-cd8db88ab1da","Type":"ContainerStarted","Data":"fb1ccbd14f5c6ca62f98f6421234b5b5414f062ef832d460f4e6a046f8a1ca09"} Jul 07 15:31:33.658989 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:33.658968 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8c4d921-feff-49e8-9fd0-0335bfd90666","Type":"ContainerStarted","Data":"0b29ccfcc5925874dfecfac9c977d996d0c607f8ef691f78e4898b9fc4d3c7c3"} Jul 07 15:31:33.719800 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:33.719755 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dh547" podStartSLOduration=1.297445943 podStartE2EDuration="2.719732996s" totalImagesPullingTime="1.422287053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:33.718700337 +0000 UTC m=+127.141419571" watchObservedRunningTime="2026-07-07 15:31:33.719732996 +0000 UTC m=+127.142452256" Jul 07 15:31:34.665802 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:34.665765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss2nv" event={"ID":"4bb3648c-6523-4c71-a46d-12307b1bba1a","Type":"ContainerStarted","Data":"e968644258081b081a8c9dd2fc8fd22e0ba55a1ac891a095060bff912419f6b6"} Jul 07 15:31:34.666245 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:34.665837 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ss2nv" event={"ID":"4bb3648c-6523-4c71-a46d-12307b1bba1a","Type":"ContainerStarted","Data":"a3f6e9d60de34d84cdea22cf56f386d25a49836fef39fe97078a469ada291d3b"} Jul 07 15:31:34.690494 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:34.690437 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ss2nv" podStartSLOduration=2.350184069 podStartE2EDuration="3.690419705s" totalImagesPullingTime="1.2599876s" totalInitContainerRuntime="80.248036ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:34.689040816 +0000 UTC m=+128.111760050" watchObservedRunningTime="2026-07-07 15:31:34.690419705 +0000 UTC m=+128.113138938" Jul 07 15:31:35.670320 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:35.670281 2561 generic.go:356] "Generic (PLEG): container finished" podID="c8c4d921-feff-49e8-9fd0-0335bfd90666" containerID="37bf0bad5ca2110f7bbd961128f9e1637bb4339772a5898abfafd07e0b72dab2" exitCode=0 Jul 07 15:31:35.670800 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:35.670367 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8c4d921-feff-49e8-9fd0-0335bfd90666","Type":"ContainerDied","Data":"37bf0bad5ca2110f7bbd961128f9e1637bb4339772a5898abfafd07e0b72dab2"} Jul 07 15:31:36.070640 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.070560 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75fc7dff59-55d2r"] Jul 07 15:31:36.072770 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.072754 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.084278 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.084251 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 15:31:36.084278 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.084264 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 15:31:36.084446 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.084288 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 15:31:36.084446 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.084371 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8kkcq\"" Jul 07 15:31:36.084446 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.084414 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 15:31:36.085515 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.085502 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3gp6q9t81q5pv\"" Jul 07 15:31:36.091959 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.091938 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75fc7dff59-55d2r"] Jul 07 15:31:36.114435 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.114400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c135db3c-2d72-48ca-b850-19cdc4102bb8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.114585 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.114443 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c135db3c-2d72-48ca-b850-19cdc4102bb8-secret-metrics-server-tls\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.114585 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.114464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c135db3c-2d72-48ca-b850-19cdc4102bb8-audit-log\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.114585 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.114514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c135db3c-2d72-48ca-b850-19cdc4102bb8-metrics-server-audit-profiles\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.114585 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.114572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c135db3c-2d72-48ca-b850-19cdc4102bb8-secret-metrics-server-client-certs\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.114710 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.114591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c135db3c-2d72-48ca-b850-19cdc4102bb8-client-ca-bundle\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.114710 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.114622 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnv5b\" (UniqueName: \"kubernetes.io/projected/c135db3c-2d72-48ca-b850-19cdc4102bb8-kube-api-access-fnv5b\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.212575 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.212540 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm"] Jul 07 15:31:36.214999 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.214981 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:36.215341 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.215302 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c135db3c-2d72-48ca-b850-19cdc4102bb8-metrics-server-audit-profiles\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.215462 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.215404 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c135db3c-2d72-48ca-b850-19cdc4102bb8-secret-metrics-server-client-certs\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.215462 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.215426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c135db3c-2d72-48ca-b850-19cdc4102bb8-client-ca-bundle\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.215462 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.215449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnv5b\" (UniqueName: \"kubernetes.io/projected/c135db3c-2d72-48ca-b850-19cdc4102bb8-kube-api-access-fnv5b\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.215626 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.215490 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c135db3c-2d72-48ca-b850-19cdc4102bb8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.215626 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.215538 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c135db3c-2d72-48ca-b850-19cdc4102bb8-secret-metrics-server-tls\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.215626 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.215565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c135db3c-2d72-48ca-b850-19cdc4102bb8-audit-log\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.215956 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.215933 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c135db3c-2d72-48ca-b850-19cdc4102bb8-audit-log\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.216224 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.216193 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c135db3c-2d72-48ca-b850-19cdc4102bb8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.216418 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.216351 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c135db3c-2d72-48ca-b850-19cdc4102bb8-metrics-server-audit-profiles\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.217794 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.217775 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 15:31:36.218203 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.218183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c135db3c-2d72-48ca-b850-19cdc4102bb8-client-ca-bundle\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.218283 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.218211 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c135db3c-2d72-48ca-b850-19cdc4102bb8-secret-metrics-server-tls\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.218283 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.218242 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jtcxz\"" Jul 07 15:31:36.218392 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.218332 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c135db3c-2d72-48ca-b850-19cdc4102bb8-secret-metrics-server-client-certs\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.232650 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.232628 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm"] Jul 07 15:31:36.233583 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.233554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnv5b\" (UniqueName: \"kubernetes.io/projected/c135db3c-2d72-48ca-b850-19cdc4102bb8-kube-api-access-fnv5b\") pod \"metrics-server-75fc7dff59-55d2r\" (UID: \"c135db3c-2d72-48ca-b850-19cdc4102bb8\") " pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.316172 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.316141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gpmrm\" (UID: \"27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:36.316372 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.316219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4rwh\" (UniqueName: \"kubernetes.io/projected/27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd-kube-api-access-j4rwh\") pod \"monitoring-plugin-d5dcff7cf-gpmrm\" (UID: \"27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:36.381188 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.381147 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:36.417699 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.417660 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4rwh\" (UniqueName: \"kubernetes.io/projected/27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd-kube-api-access-j4rwh\") pod \"monitoring-plugin-d5dcff7cf-gpmrm\" (UID: \"27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:36.417888 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.417771 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gpmrm\" (UID: \"27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:36.420595 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.420570 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gpmrm\" (UID: \"27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:36.428761 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.428730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4rwh\" (UniqueName: \"kubernetes.io/projected/27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd-kube-api-access-j4rwh\") pod \"monitoring-plugin-d5dcff7cf-gpmrm\" (UID: \"27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:36.527043 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.527011 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75fc7dff59-55d2r"] Jul 07 15:31:36.530028 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:36.529990 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc135db3c_2d72_48ca_b850_19cdc4102bb8.slice/crio-baee948d4f1677ad6d0f5d9b02210c3d13830b79bbc06b12d46ec3ff1aa385a6 WatchSource:0}: Error finding container baee948d4f1677ad6d0f5d9b02210c3d13830b79bbc06b12d46ec3ff1aa385a6: Status 404 returned error can't find the container with id baee948d4f1677ad6d0f5d9b02210c3d13830b79bbc06b12d46ec3ff1aa385a6 Jul 07 15:31:36.531680 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.531660 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:36.673114 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.672980 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm"] Jul 07 15:31:36.676757 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:36.676728 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27aa0eaf_51c7_461e_98dd_fbfeab0d5ebd.slice/crio-a7bbd189120e2a7152a8b2a9a2c2602b41ad0dd633de5f4edd4abdd59fe5e008 WatchSource:0}: Error finding container a7bbd189120e2a7152a8b2a9a2c2602b41ad0dd633de5f4edd4abdd59fe5e008: Status 404 returned error can't find the container with id a7bbd189120e2a7152a8b2a9a2c2602b41ad0dd633de5f4edd4abdd59fe5e008 Jul 07 15:31:36.677107 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.677082 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" event={"ID":"c135db3c-2d72-48ca-b850-19cdc4102bb8","Type":"ContainerStarted","Data":"baee948d4f1677ad6d0f5d9b02210c3d13830b79bbc06b12d46ec3ff1aa385a6"} Jul 07 15:31:36.821413 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.821369 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:31:36.824196 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.824172 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbd0a65c-3da5-4f09-b99d-2551a7e33c93-metrics-certs\") pod \"network-metrics-daemon-bnnp4\" (UID: \"dbd0a65c-3da5-4f09-b99d-2551a7e33c93\") " pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:31:36.972095 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.972020 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pzwr\"" Jul 07 15:31:36.979598 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:36.979577 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnnp4" Jul 07 15:31:37.127039 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:37.127005 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bnnp4"] Jul 07 15:31:37.386408 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:31:37.386372 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd0a65c_3da5_4f09_b99d_2551a7e33c93.slice/crio-099ffe551d985f01686ec1bb51d1f56ad99dcdd9d95f5c9132b23854b02f1448 WatchSource:0}: Error finding container 099ffe551d985f01686ec1bb51d1f56ad99dcdd9d95f5c9132b23854b02f1448: Status 404 returned error can't find the container with id 099ffe551d985f01686ec1bb51d1f56ad99dcdd9d95f5c9132b23854b02f1448 Jul 07 15:31:37.681986 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:37.681947 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" event={"ID":"27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd","Type":"ContainerStarted","Data":"a7bbd189120e2a7152a8b2a9a2c2602b41ad0dd633de5f4edd4abdd59fe5e008"} Jul 07 15:31:37.685344 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:37.685299 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8c4d921-feff-49e8-9fd0-0335bfd90666","Type":"ContainerStarted","Data":"7187b9649b43dfd43d5dd6a8e08017689d1e3c53afb082322026bda481d1536b"} Jul 07 15:31:37.685449 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:37.685386 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8c4d921-feff-49e8-9fd0-0335bfd90666","Type":"ContainerStarted","Data":"5156156a0bc0a09d3f0874216e99a60c2c72528a89b0db24922133263a47c061"} Jul 07 15:31:37.685449 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:37.685430 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8c4d921-feff-49e8-9fd0-0335bfd90666","Type":"ContainerStarted","Data":"61860f143e5e7826ba233edfc7582f26ae3e94f721cdec6f0385d439ec74c107"} Jul 07 15:31:37.685532 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:37.685471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8c4d921-feff-49e8-9fd0-0335bfd90666","Type":"ContainerStarted","Data":"00bc64903e086ecf714ffc2924ead805a7b956cdcace3c046198eccce7e2641e"} Jul 07 15:31:37.686743 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:37.686712 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bnnp4" event={"ID":"dbd0a65c-3da5-4f09-b99d-2551a7e33c93","Type":"ContainerStarted","Data":"099ffe551d985f01686ec1bb51d1f56ad99dcdd9d95f5c9132b23854b02f1448"} Jul 07 15:31:38.479550 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:38.479509 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d797cb784-4gjh6"] Jul 07 15:31:38.694057 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:38.694018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8c4d921-feff-49e8-9fd0-0335bfd90666","Type":"ContainerStarted","Data":"1b23b8f33dbb8ae7386cf54cf9529af3022d0a0bd364c7eadc17f287587afb09"} Jul 07 15:31:40.703847 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.703814 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" event={"ID":"27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd","Type":"ContainerStarted","Data":"c21bc89e3b1c41b99177fce5a8b82d58762f4772486d328980889d1e3406e88b"} Jul 07 15:31:40.704355 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.703995 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:40.707839 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.707809 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8c4d921-feff-49e8-9fd0-0335bfd90666","Type":"ContainerStarted","Data":"2a9253b909882fbd501610da6e47abe084869023f46365ca31eb65474046da31"} Jul 07 15:31:40.709476 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.709444 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" event={"ID":"c135db3c-2d72-48ca-b850-19cdc4102bb8","Type":"ContainerStarted","Data":"1d8ff6759ef2d183eddbf168b7e0874a2e91fd605f13f693833ef742c77daa34"} Jul 07 15:31:40.710476 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.710452 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" Jul 07 15:31:40.716573 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.716468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bnnp4" event={"ID":"dbd0a65c-3da5-4f09-b99d-2551a7e33c93","Type":"ContainerStarted","Data":"58eeac86f22834de2176fe76da6bc6770b8b90938eabfccc9323df1213596fa2"} Jul 07 15:31:40.716573 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.716545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bnnp4" event={"ID":"dbd0a65c-3da5-4f09-b99d-2551a7e33c93","Type":"ContainerStarted","Data":"06e947456456a738d7f4472d03f63ef47041ecc9593e113f61acb099e0ba3a62"} Jul 07 15:31:40.727453 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.727404 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gpmrm" podStartSLOduration=1.5193950520000001 podStartE2EDuration="4.727390664s" totalImagesPullingTime="3.207995612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:40.726064591 +0000 UTC m=+134.148783827" watchObservedRunningTime="2026-07-07 15:31:40.727390664 +0000 UTC m=+134.150109895" Jul 07 15:31:40.795165 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.794710 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.529938026 podStartE2EDuration="8.794687943s" totalImagesPullingTime="5.248650029s" totalInitContainerRuntime="16.099888ms" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:40.760612919 +0000 UTC m=+134.183332156" watchObservedRunningTime="2026-07-07 15:31:40.794687943 +0000 UTC m=+134.217407179" Jul 07 15:31:40.795367 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.795227 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" podStartSLOduration=1.440523218 podStartE2EDuration="4.795209623s" totalImagesPullingTime="3.354686405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:40.793989345 +0000 UTC m=+134.216708579" watchObservedRunningTime="2026-07-07 15:31:40.795209623 +0000 UTC m=+134.217928859" Jul 07 15:31:40.871987 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:40.871926 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bnnp4" podStartSLOduration=130.370112326 podStartE2EDuration="2m12.871908134s" totalImagesPullingTime="2.501795808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:40.870202167 +0000 UTC m=+134.292921402" watchObservedRunningTime="2026-07-07 15:31:40.871908134 +0000 UTC m=+134.294627373" Jul 07 15:31:54.770103 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:54.770070 2561 generic.go:356] "Generic (PLEG): container finished" podID="a7a20ec3-5611-4473-a9ae-1c4cb1b7987a" containerID="cdc279db1f17268765e29d0d0318ad3a714a98942ecc6fb3e3fa3ad179270da1" exitCode=0 Jul 07 15:31:54.770521 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:54.770147 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" event={"ID":"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a","Type":"ContainerDied","Data":"cdc279db1f17268765e29d0d0318ad3a714a98942ecc6fb3e3fa3ad179270da1"} Jul 07 15:31:54.770521 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:54.770459 2561 scope.go:117] "RemoveContainer" containerID="cdc279db1f17268765e29d0d0318ad3a714a98942ecc6fb3e3fa3ad179270da1" Jul 07 15:31:55.775835 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:55.775800 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-65nf5" event={"ID":"a7a20ec3-5611-4473-a9ae-1c4cb1b7987a","Type":"ContainerStarted","Data":"bacc99f2e563e8ed6bafffe6dbd4014163b45f47e781a5e5a523a6bfdc2d96e9"} Jul 07 15:31:56.381990 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:56.381948 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:31:56.382176 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:31:56.382037 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:32:03.506813 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.506749 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" podUID="5020ec8c-a735-4ff6-a6d0-5e6a78c77463" containerName="registry" containerID="cri-o://891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab" gracePeriod=30 Jul 07 15:32:03.753868 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.753847 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:32:03.755817 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.755799 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-certificates\") pod \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " Jul 07 15:32:03.755899 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.755831 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-installation-pull-secrets\") pod \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " Jul 07 15:32:03.755899 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.755862 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-ca-trust-extracted\") pod \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " Jul 07 15:32:03.755899 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.755890 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf47w\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-kube-api-access-gf47w\") pod \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " Jul 07 15:32:03.756051 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.755920 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-image-registry-private-configuration\") pod \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " Jul 07 15:32:03.756051 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.755975 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") pod \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " Jul 07 15:32:03.756051 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.756012 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-trusted-ca\") pod \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " Jul 07 15:32:03.756238 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.756112 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-bound-sa-token\") pod \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\" (UID: \"5020ec8c-a735-4ff6-a6d0-5e6a78c77463\") " Jul 07 15:32:03.756296 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.756279 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5020ec8c-a735-4ff6-a6d0-5e6a78c77463" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:32:03.756398 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.756374 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-certificates\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:32:03.756665 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.756616 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5020ec8c-a735-4ff6-a6d0-5e6a78c77463" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:32:03.758802 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.758715 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5020ec8c-a735-4ff6-a6d0-5e6a78c77463" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:32:03.758802 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.758735 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-kube-api-access-gf47w" (OuterVolumeSpecName: "kube-api-access-gf47w") pod "5020ec8c-a735-4ff6-a6d0-5e6a78c77463" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463"). InnerVolumeSpecName "kube-api-access-gf47w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:32:03.758802 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.758772 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5020ec8c-a735-4ff6-a6d0-5e6a78c77463" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:32:03.759080 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.759053 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5020ec8c-a735-4ff6-a6d0-5e6a78c77463" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:32:03.759193 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.759139 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5020ec8c-a735-4ff6-a6d0-5e6a78c77463" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:32:03.764784 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.764764 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5020ec8c-a735-4ff6-a6d0-5e6a78c77463" (UID: "5020ec8c-a735-4ff6-a6d0-5e6a78c77463"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:32:03.806457 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.806426 2561 generic.go:356] "Generic (PLEG): container finished" podID="5020ec8c-a735-4ff6-a6d0-5e6a78c77463" containerID="891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab" exitCode=0 Jul 07 15:32:03.806594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.806470 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" Jul 07 15:32:03.806594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.806504 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" event={"ID":"5020ec8c-a735-4ff6-a6d0-5e6a78c77463","Type":"ContainerDied","Data":"891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab"} Jul 07 15:32:03.806594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.806552 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d797cb784-4gjh6" event={"ID":"5020ec8c-a735-4ff6-a6d0-5e6a78c77463","Type":"ContainerDied","Data":"3bfa465b9b856785c2fb17e947befe996dce1f35ce94583b0f9da1543e13e440"} Jul 07 15:32:03.806594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.806578 2561 scope.go:117] "RemoveContainer" containerID="891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab" Jul 07 15:32:03.815310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.815293 2561 scope.go:117] "RemoveContainer" containerID="891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab" Jul 07 15:32:03.815564 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:32:03.815545 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab\": container with ID starting with 891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab not found: ID does not exist" containerID="891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab" Jul 07 15:32:03.815612 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.815571 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab"} err="failed to get container status \"891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab\": rpc error: code = NotFound desc = could not find container \"891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab\": container with ID starting with 891cf78436aa90a5bcfc7440c6a765ef7975ac75727b401ff24995100c6557ab not found: ID does not exist" Jul 07 15:32:03.829562 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.829540 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d797cb784-4gjh6"] Jul 07 15:32:03.833287 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.833265 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d797cb784-4gjh6"] Jul 07 15:32:03.857474 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.857446 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-registry-tls\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:32:03.857474 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.857470 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-trusted-ca\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:32:03.857612 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.857482 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-bound-sa-token\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:32:03.857612 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.857495 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-installation-pull-secrets\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:32:03.857612 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.857508 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-ca-trust-extracted\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:32:03.857612 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.857520 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf47w\" (UniqueName: \"kubernetes.io/projected/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-kube-api-access-gf47w\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:32:03.857612 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:03.857533 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5020ec8c-a735-4ff6-a6d0-5e6a78c77463-image-registry-private-configuration\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:32:05.158671 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:05.158631 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5020ec8c-a735-4ff6-a6d0-5e6a78c77463" path="/var/lib/kubelet/pods/5020ec8c-a735-4ff6-a6d0-5e6a78c77463/volumes" Jul 07 15:32:16.386556 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:16.386528 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:32:16.390431 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:32:16.390402 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75fc7dff59-55d2r" Jul 07 15:34:26.995848 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:26.995821 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:34:27.010382 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:27.010353 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:34:27.011304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:27.011282 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 15:34:38.636529 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.636489 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn"] Jul 07 15:34:38.638231 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.636779 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5020ec8c-a735-4ff6-a6d0-5e6a78c77463" containerName="registry" Jul 07 15:34:38.638231 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.636790 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5020ec8c-a735-4ff6-a6d0-5e6a78c77463" containerName="registry" Jul 07 15:34:38.638231 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.636850 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5020ec8c-a735-4ff6-a6d0-5e6a78c77463" containerName="registry" Jul 07 15:34:38.638698 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.638683 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.641667 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.641642 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 15:34:38.641931 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.641917 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 15:34:38.643097 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.643078 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bzqn8\"" Jul 07 15:34:38.657752 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.657725 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn"] Jul 07 15:34:38.787274 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.787238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.787274 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.787270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.787518 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.787393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c62nf\" (UniqueName: \"kubernetes.io/projected/0c42facf-9555-47be-9002-32ac187c2984-kube-api-access-c62nf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.888601 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.888494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c62nf\" (UniqueName: \"kubernetes.io/projected/0c42facf-9555-47be-9002-32ac187c2984-kube-api-access-c62nf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.888601 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.888582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.888812 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.888610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.888966 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.888943 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.889036 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.888996 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.898155 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.898110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c62nf\" (UniqueName: \"kubernetes.io/projected/0c42facf-9555-47be-9002-32ac187c2984-kube-api-access-c62nf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:38.948286 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:38.948255 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:34:39.079826 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:39.079792 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn"] Jul 07 15:34:39.082760 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:34:39.082736 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c42facf_9555_47be_9002_32ac187c2984.slice/crio-168cf0be059392a812572e79113dd60b7a137d2dbc3154d46ffa6134752cca7d WatchSource:0}: Error finding container 168cf0be059392a812572e79113dd60b7a137d2dbc3154d46ffa6134752cca7d: Status 404 returned error can't find the container with id 168cf0be059392a812572e79113dd60b7a137d2dbc3154d46ffa6134752cca7d Jul 07 15:34:39.084801 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:39.084783 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:34:39.368577 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:39.368544 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" event={"ID":"0c42facf-9555-47be-9002-32ac187c2984","Type":"ContainerStarted","Data":"168cf0be059392a812572e79113dd60b7a137d2dbc3154d46ffa6134752cca7d"} Jul 07 15:34:49.406376 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:49.406339 2561 generic.go:356] "Generic (PLEG): container finished" podID="0c42facf-9555-47be-9002-32ac187c2984" containerID="7011013dcb2ae07a3a1ed79f4fcad2b4cc4b17aa6e837906b800ee59c8b11ede" exitCode=0 Jul 07 15:34:49.406870 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:49.406391 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" event={"ID":"0c42facf-9555-47be-9002-32ac187c2984","Type":"ContainerDied","Data":"7011013dcb2ae07a3a1ed79f4fcad2b4cc4b17aa6e837906b800ee59c8b11ede"} Jul 07 15:34:53.422977 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:53.422929 2561 generic.go:356] "Generic (PLEG): container finished" podID="0c42facf-9555-47be-9002-32ac187c2984" containerID="4a418e50744a6d18957f8e2b6a42dc08ae014f850ce9dfcd5658c539f4fb19dd" exitCode=0 Jul 07 15:34:53.423361 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:34:53.422994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" event={"ID":"0c42facf-9555-47be-9002-32ac187c2984","Type":"ContainerDied","Data":"4a418e50744a6d18957f8e2b6a42dc08ae014f850ce9dfcd5658c539f4fb19dd"} Jul 07 15:35:02.462539 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:02.462509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" event={"ID":"0c42facf-9555-47be-9002-32ac187c2984","Type":"ContainerStarted","Data":"25c9b1cad7b0481bec4cb696e33a056eaaff464642c9ceb3b678b9b2c583da02"} Jul 07 15:35:02.484042 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:02.483994 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" podStartSLOduration=2.666710982 podStartE2EDuration="24.483979379s" totalImagesPullingTime="21.817268397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:34:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:02.483536246 +0000 UTC m=+335.906255480" watchObservedRunningTime="2026-07-07 15:35:02.483979379 +0000 UTC m=+335.906698614" Jul 07 15:35:03.470030 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:03.469989 2561 generic.go:356] "Generic (PLEG): container finished" podID="0c42facf-9555-47be-9002-32ac187c2984" containerID="25c9b1cad7b0481bec4cb696e33a056eaaff464642c9ceb3b678b9b2c583da02" exitCode=0 Jul 07 15:35:03.470413 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:03.470063 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" event={"ID":"0c42facf-9555-47be-9002-32ac187c2984","Type":"ContainerDied","Data":"25c9b1cad7b0481bec4cb696e33a056eaaff464642c9ceb3b678b9b2c583da02"} Jul 07 15:35:04.596529 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.596505 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:35:04.705483 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.705447 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-bundle\") pod \"0c42facf-9555-47be-9002-32ac187c2984\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " Jul 07 15:35:04.705640 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.705492 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-util\") pod \"0c42facf-9555-47be-9002-32ac187c2984\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " Jul 07 15:35:04.705640 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.705513 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c62nf\" (UniqueName: \"kubernetes.io/projected/0c42facf-9555-47be-9002-32ac187c2984-kube-api-access-c62nf\") pod \"0c42facf-9555-47be-9002-32ac187c2984\" (UID: \"0c42facf-9555-47be-9002-32ac187c2984\") " Jul 07 15:35:04.706311 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.706275 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-bundle" (OuterVolumeSpecName: "bundle") pod "0c42facf-9555-47be-9002-32ac187c2984" (UID: "0c42facf-9555-47be-9002-32ac187c2984"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:35:04.707895 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.707874 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c42facf-9555-47be-9002-32ac187c2984-kube-api-access-c62nf" (OuterVolumeSpecName: "kube-api-access-c62nf") pod "0c42facf-9555-47be-9002-32ac187c2984" (UID: "0c42facf-9555-47be-9002-32ac187c2984"). InnerVolumeSpecName "kube-api-access-c62nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:35:04.710085 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.710063 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-util" (OuterVolumeSpecName: "util") pod "0c42facf-9555-47be-9002-32ac187c2984" (UID: "0c42facf-9555-47be-9002-32ac187c2984"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:35:04.807012 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.806924 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-bundle\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:35:04.807012 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.806953 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c42facf-9555-47be-9002-32ac187c2984-util\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:35:04.807012 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:04.806961 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c62nf\" (UniqueName: \"kubernetes.io/projected/0c42facf-9555-47be-9002-32ac187c2984-kube-api-access-c62nf\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:35:05.479416 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:05.479325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" event={"ID":"0c42facf-9555-47be-9002-32ac187c2984","Type":"ContainerDied","Data":"168cf0be059392a812572e79113dd60b7a137d2dbc3154d46ffa6134752cca7d"} Jul 07 15:35:05.479416 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:05.479369 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf7wn" Jul 07 15:35:05.479416 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:05.479382 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="168cf0be059392a812572e79113dd60b7a137d2dbc3154d46ffa6134752cca7d" Jul 07 15:35:11.937889 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.937853 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc"] Jul 07 15:35:11.938310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.938140 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c42facf-9555-47be-9002-32ac187c2984" containerName="pull" Jul 07 15:35:11.938310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.938152 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c42facf-9555-47be-9002-32ac187c2984" containerName="pull" Jul 07 15:35:11.938310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.938160 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c42facf-9555-47be-9002-32ac187c2984" containerName="extract" Jul 07 15:35:11.938310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.938166 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c42facf-9555-47be-9002-32ac187c2984" containerName="extract" Jul 07 15:35:11.938310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.938179 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c42facf-9555-47be-9002-32ac187c2984" containerName="util" Jul 07 15:35:11.938310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.938186 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c42facf-9555-47be-9002-32ac187c2984" containerName="util" Jul 07 15:35:11.938310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.938231 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c42facf-9555-47be-9002-32ac187c2984" containerName="extract" Jul 07 15:35:11.940331 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.940315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" Jul 07 15:35:11.943101 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.943053 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bbm8h\"" Jul 07 15:35:11.943312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.943291 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 15:35:11.943369 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.943334 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:35:11.959813 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:11.959788 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc"] Jul 07 15:35:12.060518 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:12.060476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2vjh\" (UniqueName: \"kubernetes.io/projected/1178d637-b032-40b7-a2f6-e823e8d9ea12-kube-api-access-x2vjh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8wjdc\" (UID: \"1178d637-b032-40b7-a2f6-e823e8d9ea12\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" Jul 07 15:35:12.060518 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:12.060525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1178d637-b032-40b7-a2f6-e823e8d9ea12-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8wjdc\" (UID: \"1178d637-b032-40b7-a2f6-e823e8d9ea12\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" Jul 07 15:35:12.161907 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:12.161876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2vjh\" (UniqueName: \"kubernetes.io/projected/1178d637-b032-40b7-a2f6-e823e8d9ea12-kube-api-access-x2vjh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8wjdc\" (UID: \"1178d637-b032-40b7-a2f6-e823e8d9ea12\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" Jul 07 15:35:12.161907 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:12.161917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1178d637-b032-40b7-a2f6-e823e8d9ea12-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8wjdc\" (UID: \"1178d637-b032-40b7-a2f6-e823e8d9ea12\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" Jul 07 15:35:12.162259 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:12.162244 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1178d637-b032-40b7-a2f6-e823e8d9ea12-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8wjdc\" (UID: \"1178d637-b032-40b7-a2f6-e823e8d9ea12\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" Jul 07 15:35:12.174426 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:12.174403 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2vjh\" (UniqueName: \"kubernetes.io/projected/1178d637-b032-40b7-a2f6-e823e8d9ea12-kube-api-access-x2vjh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8wjdc\" (UID: \"1178d637-b032-40b7-a2f6-e823e8d9ea12\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" Jul 07 15:35:12.249239 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:12.249146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" Jul 07 15:35:12.398788 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:12.398761 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc"] Jul 07 15:35:12.400890 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:35:12.400862 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1178d637_b032_40b7_a2f6_e823e8d9ea12.slice/crio-07743eb866121f66b0ad9780adaa584568d759e1f7ae6e49657f846a61fa0228 WatchSource:0}: Error finding container 07743eb866121f66b0ad9780adaa584568d759e1f7ae6e49657f846a61fa0228: Status 404 returned error can't find the container with id 07743eb866121f66b0ad9780adaa584568d759e1f7ae6e49657f846a61fa0228 Jul 07 15:35:12.507210 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:12.507112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" event={"ID":"1178d637-b032-40b7-a2f6-e823e8d9ea12","Type":"ContainerStarted","Data":"07743eb866121f66b0ad9780adaa584568d759e1f7ae6e49657f846a61fa0228"} Jul 07 15:35:14.517311 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:14.517268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" event={"ID":"1178d637-b032-40b7-a2f6-e823e8d9ea12","Type":"ContainerStarted","Data":"8c3cd01cca74da843bd612bc7fdab4d69de1cf53417118cf07210089b9cc51cb"} Jul 07 15:35:14.558184 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:14.558090 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8wjdc" podStartSLOduration=1.956103455 podStartE2EDuration="3.558074878s" totalImagesPullingTime="1.601971423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:14.556603422 +0000 UTC m=+347.979322666" watchObservedRunningTime="2026-07-07 15:35:14.558074878 +0000 UTC m=+347.980794111" Jul 07 15:35:15.729444 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.729408 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x"] Jul 07 15:35:15.731804 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.731785 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:15.734677 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.734658 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 15:35:15.735769 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.735754 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bzqn8\"" Jul 07 15:35:15.735828 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.735755 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 15:35:15.744166 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.744139 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x"] Jul 07 15:35:15.793940 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.793908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6f24\" (UniqueName: \"kubernetes.io/projected/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-kube-api-access-z6f24\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:15.793940 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.793942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:15.794187 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.793963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:15.895310 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.895276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6f24\" (UniqueName: \"kubernetes.io/projected/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-kube-api-access-z6f24\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:15.895466 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.895318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:15.895466 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.895340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:15.895697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.895677 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:15.895733 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.895695 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:15.915338 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:15.915314 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6f24\" (UniqueName: \"kubernetes.io/projected/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-kube-api-access-z6f24\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:16.041906 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:16.041802 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:16.194404 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:16.194381 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x"] Jul 07 15:35:16.197196 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:35:16.197164 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2d17b9_6cca_4f2a_9b30_7ef0e226e9a5.slice/crio-57de0647b48d7139322844ad895f10093ebb7a17c124124312714ef8d2998253 WatchSource:0}: Error finding container 57de0647b48d7139322844ad895f10093ebb7a17c124124312714ef8d2998253: Status 404 returned error can't find the container with id 57de0647b48d7139322844ad895f10093ebb7a17c124124312714ef8d2998253 Jul 07 15:35:16.527003 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:16.526966 2561 generic.go:356] "Generic (PLEG): container finished" podID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerID="bdb511d6cb5ca9e60015508ab4a0a3d2db8ed8494db060568e6012a909669fe4" exitCode=0 Jul 07 15:35:16.527161 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:16.527020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" event={"ID":"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5","Type":"ContainerDied","Data":"bdb511d6cb5ca9e60015508ab4a0a3d2db8ed8494db060568e6012a909669fe4"} Jul 07 15:35:16.527161 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:16.527072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" event={"ID":"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5","Type":"ContainerStarted","Data":"57de0647b48d7139322844ad895f10093ebb7a17c124124312714ef8d2998253"} Jul 07 15:35:18.381566 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.381486 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9"] Jul 07 15:35:18.388898 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.388866 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" Jul 07 15:35:18.391798 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.391768 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-g6l5d\"" Jul 07 15:35:18.391798 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.391788 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 15:35:18.392796 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.392768 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 15:35:18.396347 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.396324 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9"] Jul 07 15:35:18.516591 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.516552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gf9\" (UniqueName: \"kubernetes.io/projected/79aba4fa-af0c-4d45-b7bd-db68ea3e01a0-kube-api-access-x7gf9\") pod \"cert-manager-cainjector-559cdd8c87-q9tb9\" (UID: \"79aba4fa-af0c-4d45-b7bd-db68ea3e01a0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" Jul 07 15:35:18.516758 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.516634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79aba4fa-af0c-4d45-b7bd-db68ea3e01a0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q9tb9\" (UID: \"79aba4fa-af0c-4d45-b7bd-db68ea3e01a0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" Jul 07 15:35:18.617521 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.617479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gf9\" (UniqueName: \"kubernetes.io/projected/79aba4fa-af0c-4d45-b7bd-db68ea3e01a0-kube-api-access-x7gf9\") pod \"cert-manager-cainjector-559cdd8c87-q9tb9\" (UID: \"79aba4fa-af0c-4d45-b7bd-db68ea3e01a0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" Jul 07 15:35:18.617738 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.617555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79aba4fa-af0c-4d45-b7bd-db68ea3e01a0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q9tb9\" (UID: \"79aba4fa-af0c-4d45-b7bd-db68ea3e01a0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" Jul 07 15:35:18.627033 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.627006 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79aba4fa-af0c-4d45-b7bd-db68ea3e01a0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q9tb9\" (UID: \"79aba4fa-af0c-4d45-b7bd-db68ea3e01a0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" Jul 07 15:35:18.627299 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.627274 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gf9\" (UniqueName: \"kubernetes.io/projected/79aba4fa-af0c-4d45-b7bd-db68ea3e01a0-kube-api-access-x7gf9\") pod \"cert-manager-cainjector-559cdd8c87-q9tb9\" (UID: \"79aba4fa-af0c-4d45-b7bd-db68ea3e01a0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" Jul 07 15:35:18.700587 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:18.700507 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" Jul 07 15:35:19.030488 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:19.030459 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9"] Jul 07 15:35:19.034178 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:35:19.034145 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79aba4fa_af0c_4d45_b7bd_db68ea3e01a0.slice/crio-e2928ca0a96e93434c108e3e9a0580744201a3a1e71f45d5accd442e538f8543 WatchSource:0}: Error finding container e2928ca0a96e93434c108e3e9a0580744201a3a1e71f45d5accd442e538f8543: Status 404 returned error can't find the container with id e2928ca0a96e93434c108e3e9a0580744201a3a1e71f45d5accd442e538f8543 Jul 07 15:35:19.543788 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:19.543754 2561 generic.go:356] "Generic (PLEG): container finished" podID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerID="64e143b2334895c4bd5d13888c794c55f889c5e9a75f7b2d3a0f477824721049" exitCode=0 Jul 07 15:35:19.544243 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:19.543845 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" event={"ID":"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5","Type":"ContainerDied","Data":"64e143b2334895c4bd5d13888c794c55f889c5e9a75f7b2d3a0f477824721049"} Jul 07 15:35:19.544989 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:19.544965 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" event={"ID":"79aba4fa-af0c-4d45-b7bd-db68ea3e01a0","Type":"ContainerStarted","Data":"e2928ca0a96e93434c108e3e9a0580744201a3a1e71f45d5accd442e538f8543"} Jul 07 15:35:20.552537 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:20.552505 2561 generic.go:356] "Generic (PLEG): container finished" podID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerID="184af4a4e16b58f67b1be3ea073b22db0e822d2d3fde76a6cab7ed637907f91c" exitCode=0 Jul 07 15:35:20.553055 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:20.552585 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" event={"ID":"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5","Type":"ContainerDied","Data":"184af4a4e16b58f67b1be3ea073b22db0e822d2d3fde76a6cab7ed637907f91c"} Jul 07 15:35:22.435369 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.435347 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:22.553141 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.553093 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6f24\" (UniqueName: \"kubernetes.io/projected/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-kube-api-access-z6f24\") pod \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " Jul 07 15:35:22.553303 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.553201 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-util\") pod \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " Jul 07 15:35:22.553303 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.553251 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-bundle\") pod \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\" (UID: \"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5\") " Jul 07 15:35:22.553780 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.553728 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-bundle" (OuterVolumeSpecName: "bundle") pod "6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" (UID: "6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:35:22.555789 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.555764 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-kube-api-access-z6f24" (OuterVolumeSpecName: "kube-api-access-z6f24") pod "6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" (UID: "6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5"). InnerVolumeSpecName "kube-api-access-z6f24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:35:22.560759 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.560733 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-util" (OuterVolumeSpecName: "util") pod "6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" (UID: "6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:35:22.564260 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.564233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" event={"ID":"6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5","Type":"ContainerDied","Data":"57de0647b48d7139322844ad895f10093ebb7a17c124124312714ef8d2998253"} Jul 07 15:35:22.564380 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.564284 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57de0647b48d7139322844ad895f10093ebb7a17c124124312714ef8d2998253" Jul 07 15:35:22.564380 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.564242 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftzl7x" Jul 07 15:35:22.565894 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.565814 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" event={"ID":"79aba4fa-af0c-4d45-b7bd-db68ea3e01a0","Type":"ContainerStarted","Data":"fae14b80f52d89210e2c23b36e5b01f57b996332ae24d9dbc690ac49df04e204"} Jul 07 15:35:22.587956 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.587911 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q9tb9" podStartSLOduration=1.1487591560000001 podStartE2EDuration="4.587897151s" totalImagesPullingTime="3.439137995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:22.587106433 +0000 UTC m=+356.009825666" watchObservedRunningTime="2026-07-07 15:35:22.587897151 +0000 UTC m=+356.010616384" Jul 07 15:35:22.654851 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.654822 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-util\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:35:22.654851 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.654847 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-bundle\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:35:22.654851 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:22.654855 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6f24\" (UniqueName: \"kubernetes.io/projected/6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5-kube-api-access-z6f24\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:35:33.459886 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.459849 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s"] Jul 07 15:35:33.460301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.460173 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerName="pull" Jul 07 15:35:33.460301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.460187 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerName="pull" Jul 07 15:35:33.460301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.460199 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerName="util" Jul 07 15:35:33.460301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.460213 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerName="util" Jul 07 15:35:33.460301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.460225 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerName="extract" Jul 07 15:35:33.460301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.460230 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerName="extract" Jul 07 15:35:33.460301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.460292 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e2d17b9-6cca-4f2a-9b30-7ef0e226e9a5" containerName="extract" Jul 07 15:35:33.509075 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.509038 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s"] Jul 07 15:35:33.509249 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.509167 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" Jul 07 15:35:33.512459 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.512432 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 15:35:33.513261 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.513242 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9xnvw\"" Jul 07 15:35:33.513261 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.513269 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:35:33.647270 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.647228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/432fc989-ada8-4840-96f3-10cd49cfb264-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zvl2s\" (UID: \"432fc989-ada8-4840-96f3-10cd49cfb264\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" Jul 07 15:35:33.647270 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.647275 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcz7b\" (UniqueName: \"kubernetes.io/projected/432fc989-ada8-4840-96f3-10cd49cfb264-kube-api-access-lcz7b\") pod \"openshift-lws-operator-fd8ccff4c-zvl2s\" (UID: \"432fc989-ada8-4840-96f3-10cd49cfb264\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" Jul 07 15:35:33.748335 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.748252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/432fc989-ada8-4840-96f3-10cd49cfb264-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zvl2s\" (UID: \"432fc989-ada8-4840-96f3-10cd49cfb264\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" Jul 07 15:35:33.748335 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.748294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcz7b\" (UniqueName: \"kubernetes.io/projected/432fc989-ada8-4840-96f3-10cd49cfb264-kube-api-access-lcz7b\") pod \"openshift-lws-operator-fd8ccff4c-zvl2s\" (UID: \"432fc989-ada8-4840-96f3-10cd49cfb264\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" Jul 07 15:35:33.748643 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.748623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/432fc989-ada8-4840-96f3-10cd49cfb264-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zvl2s\" (UID: \"432fc989-ada8-4840-96f3-10cd49cfb264\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" Jul 07 15:35:33.758981 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.758961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcz7b\" (UniqueName: \"kubernetes.io/projected/432fc989-ada8-4840-96f3-10cd49cfb264-kube-api-access-lcz7b\") pod \"openshift-lws-operator-fd8ccff4c-zvl2s\" (UID: \"432fc989-ada8-4840-96f3-10cd49cfb264\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" Jul 07 15:35:33.818572 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.818539 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" Jul 07 15:35:33.982934 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:33.982899 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s"] Jul 07 15:35:33.986277 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:35:33.986251 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod432fc989_ada8_4840_96f3_10cd49cfb264.slice/crio-9527ae272f011018cfc691a8474b5401c9cbde1ca13edc4d0ecccc8d05b4ea8a WatchSource:0}: Error finding container 9527ae272f011018cfc691a8474b5401c9cbde1ca13edc4d0ecccc8d05b4ea8a: Status 404 returned error can't find the container with id 9527ae272f011018cfc691a8474b5401c9cbde1ca13edc4d0ecccc8d05b4ea8a Jul 07 15:35:34.618779 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:34.618746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" event={"ID":"432fc989-ada8-4840-96f3-10cd49cfb264","Type":"ContainerStarted","Data":"9527ae272f011018cfc691a8474b5401c9cbde1ca13edc4d0ecccc8d05b4ea8a"} Jul 07 15:35:36.629823 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:36.629783 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" event={"ID":"432fc989-ada8-4840-96f3-10cd49cfb264","Type":"ContainerStarted","Data":"d205c011c76a2927400f2fba492b9c92ec9dc1a22da07193e94c11689a9db3fe"} Jul 07 15:35:36.651385 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:36.651323 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zvl2s" podStartSLOduration=1.835489814 podStartE2EDuration="3.651306519s" totalImagesPullingTime="1.815816705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:36.649186536 +0000 UTC m=+370.071905771" watchObservedRunningTime="2026-07-07 15:35:36.651306519 +0000 UTC m=+370.074025752" Jul 07 15:35:39.295615 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.295578 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n"] Jul 07 15:35:39.297966 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.297949 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.299950 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.299930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.300057 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.299959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.300057 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.299985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tdvv\" (UniqueName: \"kubernetes.io/projected/17a4c286-8af0-442b-80cb-3f81283b250f-kube-api-access-8tdvv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.300795 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.300775 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bzqn8\"" Jul 07 15:35:39.301289 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.301271 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 15:35:39.301818 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.301801 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 15:35:39.309586 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.309561 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n"] Jul 07 15:35:39.401250 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.401218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.401427 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.401257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.401427 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.401296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tdvv\" (UniqueName: \"kubernetes.io/projected/17a4c286-8af0-442b-80cb-3f81283b250f-kube-api-access-8tdvv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.401691 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.401674 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.401726 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.401697 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.417843 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.417791 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tdvv\" (UniqueName: \"kubernetes.io/projected/17a4c286-8af0-442b-80cb-3f81283b250f-kube-api-access-8tdvv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.607503 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.607466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:39.742612 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:39.742479 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n"] Jul 07 15:35:39.744692 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:35:39.744664 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a4c286_8af0_442b_80cb_3f81283b250f.slice/crio-70a90252575ce2e6c7817b9b64870d4d5b04825850fc109021130196c942541c WatchSource:0}: Error finding container 70a90252575ce2e6c7817b9b64870d4d5b04825850fc109021130196c942541c: Status 404 returned error can't find the container with id 70a90252575ce2e6c7817b9b64870d4d5b04825850fc109021130196c942541c Jul 07 15:35:40.649262 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:40.649226 2561 generic.go:356] "Generic (PLEG): container finished" podID="17a4c286-8af0-442b-80cb-3f81283b250f" containerID="b01bedc6a298e65077422de87303fc4c2fad6c6ae61a3274c4509e9aef6bcff6" exitCode=0 Jul 07 15:35:40.649664 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:40.649314 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" event={"ID":"17a4c286-8af0-442b-80cb-3f81283b250f","Type":"ContainerDied","Data":"b01bedc6a298e65077422de87303fc4c2fad6c6ae61a3274c4509e9aef6bcff6"} Jul 07 15:35:40.649664 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:40.649366 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" event={"ID":"17a4c286-8af0-442b-80cb-3f81283b250f","Type":"ContainerStarted","Data":"70a90252575ce2e6c7817b9b64870d4d5b04825850fc109021130196c942541c"} Jul 07 15:35:41.655406 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:41.655371 2561 generic.go:356] "Generic (PLEG): container finished" podID="17a4c286-8af0-442b-80cb-3f81283b250f" containerID="2ecb3dfe1e602e45270924e0a54bef9c6829a23bb929b2de9bd6730d213e2762" exitCode=0 Jul 07 15:35:41.655784 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:41.655423 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" event={"ID":"17a4c286-8af0-442b-80cb-3f81283b250f","Type":"ContainerDied","Data":"2ecb3dfe1e602e45270924e0a54bef9c6829a23bb929b2de9bd6730d213e2762"} Jul 07 15:35:42.661941 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:42.661907 2561 generic.go:356] "Generic (PLEG): container finished" podID="17a4c286-8af0-442b-80cb-3f81283b250f" containerID="9b2b6ba01151e7c0102d15c74d465aec97ba91f213c531352570727fc0e3459d" exitCode=0 Jul 07 15:35:42.662327 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:42.661989 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" event={"ID":"17a4c286-8af0-442b-80cb-3f81283b250f","Type":"ContainerDied","Data":"9b2b6ba01151e7c0102d15c74d465aec97ba91f213c531352570727fc0e3459d"} Jul 07 15:35:43.799698 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.799675 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:43.834468 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.834433 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-util\") pod \"17a4c286-8af0-442b-80cb-3f81283b250f\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " Jul 07 15:35:43.834624 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.834511 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-bundle\") pod \"17a4c286-8af0-442b-80cb-3f81283b250f\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " Jul 07 15:35:43.834624 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.834576 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tdvv\" (UniqueName: \"kubernetes.io/projected/17a4c286-8af0-442b-80cb-3f81283b250f-kube-api-access-8tdvv\") pod \"17a4c286-8af0-442b-80cb-3f81283b250f\" (UID: \"17a4c286-8af0-442b-80cb-3f81283b250f\") " Jul 07 15:35:43.835246 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.835220 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-bundle" (OuterVolumeSpecName: "bundle") pod "17a4c286-8af0-442b-80cb-3f81283b250f" (UID: "17a4c286-8af0-442b-80cb-3f81283b250f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:35:43.836803 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.836779 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17a4c286-8af0-442b-80cb-3f81283b250f-kube-api-access-8tdvv" (OuterVolumeSpecName: "kube-api-access-8tdvv") pod "17a4c286-8af0-442b-80cb-3f81283b250f" (UID: "17a4c286-8af0-442b-80cb-3f81283b250f"). InnerVolumeSpecName "kube-api-access-8tdvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:35:43.840104 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.840068 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-util" (OuterVolumeSpecName: "util") pod "17a4c286-8af0-442b-80cb-3f81283b250f" (UID: "17a4c286-8af0-442b-80cb-3f81283b250f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:35:43.935808 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.935720 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tdvv\" (UniqueName: \"kubernetes.io/projected/17a4c286-8af0-442b-80cb-3f81283b250f-kube-api-access-8tdvv\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:35:43.935808 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.935754 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-util\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:35:43.935808 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:43.935763 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17a4c286-8af0-442b-80cb-3f81283b250f-bundle\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:35:44.672214 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:44.672162 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" event={"ID":"17a4c286-8af0-442b-80cb-3f81283b250f","Type":"ContainerDied","Data":"70a90252575ce2e6c7817b9b64870d4d5b04825850fc109021130196c942541c"} Jul 07 15:35:44.672214 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:44.672200 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt77n" Jul 07 15:35:44.672462 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:44.672217 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70a90252575ce2e6c7817b9b64870d4d5b04825850fc109021130196c942541c" Jul 07 15:35:52.175605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.175562 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw"] Jul 07 15:35:52.176072 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.175970 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a4c286-8af0-442b-80cb-3f81283b250f" containerName="pull" Jul 07 15:35:52.176072 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.175988 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a4c286-8af0-442b-80cb-3f81283b250f" containerName="pull" Jul 07 15:35:52.176072 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.176002 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a4c286-8af0-442b-80cb-3f81283b250f" containerName="util" Jul 07 15:35:52.176072 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.176011 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a4c286-8af0-442b-80cb-3f81283b250f" containerName="util" Jul 07 15:35:52.176072 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.176031 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a4c286-8af0-442b-80cb-3f81283b250f" containerName="extract" Jul 07 15:35:52.176072 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.176040 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a4c286-8af0-442b-80cb-3f81283b250f" containerName="extract" Jul 07 15:35:52.176426 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.176139 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="17a4c286-8af0-442b-80cb-3f81283b250f" containerName="extract" Jul 07 15:35:52.178689 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.178667 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.181465 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.181439 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 15:35:52.181648 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.181629 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cn75m\"" Jul 07 15:35:52.182055 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.181892 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 15:35:52.182055 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.181944 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 15:35:52.182055 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.181974 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 15:35:52.199440 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.199415 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw"] Jul 07 15:35:52.201180 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.201154 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-manifests\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.201278 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.201222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-tmp\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.201278 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.201263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kl6f\" (UniqueName: \"kubernetes.io/projected/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-kube-api-access-2kl6f\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.201392 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.201297 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.201392 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.201329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-webhook-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.301859 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.301824 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-manifests\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.302060 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.301870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-tmp\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.302060 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.301896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kl6f\" (UniqueName: \"kubernetes.io/projected/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-kube-api-access-2kl6f\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.302060 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.301926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.302060 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.301956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-webhook-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.302324 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.302301 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-manifests\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.304489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.304459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-tmp\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.304697 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.304677 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-webhook-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.304738 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.304677 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.312324 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.312300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kl6f\" (UniqueName: \"kubernetes.io/projected/00c88abe-6c87-4d97-aa5c-70f0d9fb6181-kube-api-access-2kl6f\") pod \"opendatahub-operator-controller-manager-578f9687cc-95jlw\" (UID: \"00c88abe-6c87-4d97-aa5c-70f0d9fb6181\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.489527 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.489433 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:52.642326 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.642300 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw"] Jul 07 15:35:52.644991 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:35:52.644970 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c88abe_6c87_4d97_aa5c_70f0d9fb6181.slice/crio-76ead19e1cbcdf98666e635ee890a019d3de366e181fba652f2c51778edfdd62 WatchSource:0}: Error finding container 76ead19e1cbcdf98666e635ee890a019d3de366e181fba652f2c51778edfdd62: Status 404 returned error can't find the container with id 76ead19e1cbcdf98666e635ee890a019d3de366e181fba652f2c51778edfdd62 Jul 07 15:35:52.707072 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:52.707031 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" event={"ID":"00c88abe-6c87-4d97-aa5c-70f0d9fb6181","Type":"ContainerStarted","Data":"76ead19e1cbcdf98666e635ee890a019d3de366e181fba652f2c51778edfdd62"} Jul 07 15:35:56.729765 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:56.729724 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" event={"ID":"00c88abe-6c87-4d97-aa5c-70f0d9fb6181","Type":"ContainerStarted","Data":"c857955841e352ae76fb7380d23402923f4024f26b51c388f25de1d25421df72"} Jul 07 15:35:57.735455 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:57.735413 2561 generic.go:356] "Generic (PLEG): container finished" podID="00c88abe-6c87-4d97-aa5c-70f0d9fb6181" containerID="c857955841e352ae76fb7380d23402923f4024f26b51c388f25de1d25421df72" exitCode=0 Jul 07 15:35:57.735939 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:57.735499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" event={"ID":"00c88abe-6c87-4d97-aa5c-70f0d9fb6181","Type":"ContainerDied","Data":"c857955841e352ae76fb7380d23402923f4024f26b51c388f25de1d25421df72"} Jul 07 15:35:58.741690 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:58.741653 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" event={"ID":"00c88abe-6c87-4d97-aa5c-70f0d9fb6181","Type":"ContainerStarted","Data":"97758c946f1bd83fa10ef6af62025d185b99b52a2c75b94e3a3e94967cd3e197"} Jul 07 15:35:58.742165 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:58.741731 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:35:58.771845 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:35:58.771791 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" podStartSLOduration=2.209423132 podStartE2EDuration="6.771774745s" totalImagesPullingTime="3.479908582s" totalInitContainerRuntime="1.082443031s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:58.769372538 +0000 UTC m=+392.192091774" watchObservedRunningTime="2026-07-07 15:35:58.771774745 +0000 UTC m=+392.194493979" Jul 07 15:36:09.748495 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:09.748461 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-95jlw" Jul 07 15:36:12.627376 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.627336 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h"] Jul 07 15:36:12.633365 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.633340 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.640230 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.639850 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 15:36:12.640230 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.640188 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 15:36:12.640374 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.640232 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 15:36:12.640374 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.640195 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nwq86\"" Jul 07 15:36:12.640467 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.640428 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 15:36:12.652769 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.652738 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h"] Jul 07 15:36:12.764955 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.764913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ae57d4-b952-4853-ad0b-f151f4c12b3d-tls-certs\") pod \"kube-auth-proxy-6fd979f9c8-tb47h\" (UID: \"b0ae57d4-b952-4853-ad0b-f151f4c12b3d\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.765195 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.764989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-489lj\" (UniqueName: \"kubernetes.io/projected/b0ae57d4-b952-4853-ad0b-f151f4c12b3d-kube-api-access-489lj\") pod \"kube-auth-proxy-6fd979f9c8-tb47h\" (UID: \"b0ae57d4-b952-4853-ad0b-f151f4c12b3d\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.765195 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.765032 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0ae57d4-b952-4853-ad0b-f151f4c12b3d-tmp\") pod \"kube-auth-proxy-6fd979f9c8-tb47h\" (UID: \"b0ae57d4-b952-4853-ad0b-f151f4c12b3d\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.866046 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.866008 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0ae57d4-b952-4853-ad0b-f151f4c12b3d-tmp\") pod \"kube-auth-proxy-6fd979f9c8-tb47h\" (UID: \"b0ae57d4-b952-4853-ad0b-f151f4c12b3d\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.866247 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.866076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ae57d4-b952-4853-ad0b-f151f4c12b3d-tls-certs\") pod \"kube-auth-proxy-6fd979f9c8-tb47h\" (UID: \"b0ae57d4-b952-4853-ad0b-f151f4c12b3d\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.866247 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.866112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-489lj\" (UniqueName: \"kubernetes.io/projected/b0ae57d4-b952-4853-ad0b-f151f4c12b3d-kube-api-access-489lj\") pod \"kube-auth-proxy-6fd979f9c8-tb47h\" (UID: \"b0ae57d4-b952-4853-ad0b-f151f4c12b3d\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.868594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.868571 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0ae57d4-b952-4853-ad0b-f151f4c12b3d-tmp\") pod \"kube-auth-proxy-6fd979f9c8-tb47h\" (UID: \"b0ae57d4-b952-4853-ad0b-f151f4c12b3d\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.868660 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.868648 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ae57d4-b952-4853-ad0b-f151f4c12b3d-tls-certs\") pod \"kube-auth-proxy-6fd979f9c8-tb47h\" (UID: \"b0ae57d4-b952-4853-ad0b-f151f4c12b3d\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.880094 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.880024 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nfxv4"] Jul 07 15:36:12.882568 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.882548 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:12.884995 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.884975 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 15:36:12.885429 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.885411 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bs8xd\"" Jul 07 15:36:12.886969 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.886951 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-489lj\" (UniqueName: \"kubernetes.io/projected/b0ae57d4-b952-4853-ad0b-f151f4c12b3d-kube-api-access-489lj\") pod \"kube-auth-proxy-6fd979f9c8-tb47h\" (UID: \"b0ae57d4-b952-4853-ad0b-f151f4c12b3d\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.907700 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.907676 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nfxv4"] Jul 07 15:36:12.943005 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.942974 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" Jul 07 15:36:12.967362 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.967333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4bn2\" (UniqueName: \"kubernetes.io/projected/d84189d7-9972-420e-84cf-42fd69638c86-kube-api-access-p4bn2\") pod \"odh-model-controller-7998c67dc4-nfxv4\" (UID: \"d84189d7-9972-420e-84cf-42fd69638c86\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:12.967506 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:12.967402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d84189d7-9972-420e-84cf-42fd69638c86-cert\") pod \"odh-model-controller-7998c67dc4-nfxv4\" (UID: \"d84189d7-9972-420e-84cf-42fd69638c86\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:13.068398 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:13.068367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4bn2\" (UniqueName: \"kubernetes.io/projected/d84189d7-9972-420e-84cf-42fd69638c86-kube-api-access-p4bn2\") pod \"odh-model-controller-7998c67dc4-nfxv4\" (UID: \"d84189d7-9972-420e-84cf-42fd69638c86\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:13.068595 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:13.068433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d84189d7-9972-420e-84cf-42fd69638c86-cert\") pod \"odh-model-controller-7998c67dc4-nfxv4\" (UID: \"d84189d7-9972-420e-84cf-42fd69638c86\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:13.068595 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:36:13.068543 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 07 15:36:13.068720 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:36:13.068665 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d84189d7-9972-420e-84cf-42fd69638c86-cert podName:d84189d7-9972-420e-84cf-42fd69638c86 nodeName:}" failed. No retries permitted until 2026-07-07 15:36:13.568640448 +0000 UTC m=+406.991359674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d84189d7-9972-420e-84cf-42fd69638c86-cert") pod "odh-model-controller-7998c67dc4-nfxv4" (UID: "d84189d7-9972-420e-84cf-42fd69638c86") : secret "odh-model-controller-webhook-cert" not found Jul 07 15:36:13.091331 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:13.091298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4bn2\" (UniqueName: \"kubernetes.io/projected/d84189d7-9972-420e-84cf-42fd69638c86-kube-api-access-p4bn2\") pod \"odh-model-controller-7998c67dc4-nfxv4\" (UID: \"d84189d7-9972-420e-84cf-42fd69638c86\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:13.096335 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:13.096307 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h"] Jul 07 15:36:13.103699 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:36:13.103672 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ae57d4_b952_4853_ad0b_f151f4c12b3d.slice/crio-b780a3e062a58c7aafe3c666d4cc8f28d389c99805ea7cba1aa060ef389fb878 WatchSource:0}: Error finding container b780a3e062a58c7aafe3c666d4cc8f28d389c99805ea7cba1aa060ef389fb878: Status 404 returned error can't find the container with id b780a3e062a58c7aafe3c666d4cc8f28d389c99805ea7cba1aa060ef389fb878 Jul 07 15:36:13.573888 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:13.573845 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d84189d7-9972-420e-84cf-42fd69638c86-cert\") pod \"odh-model-controller-7998c67dc4-nfxv4\" (UID: \"d84189d7-9972-420e-84cf-42fd69638c86\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:13.576395 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:13.576377 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d84189d7-9972-420e-84cf-42fd69638c86-cert\") pod \"odh-model-controller-7998c67dc4-nfxv4\" (UID: \"d84189d7-9972-420e-84cf-42fd69638c86\") " pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:13.799295 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:13.799252 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:13.821056 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:13.821022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" event={"ID":"b0ae57d4-b952-4853-ad0b-f151f4c12b3d","Type":"ContainerStarted","Data":"b780a3e062a58c7aafe3c666d4cc8f28d389c99805ea7cba1aa060ef389fb878"} Jul 07 15:36:13.977147 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:13.976904 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nfxv4"] Jul 07 15:36:13.979728 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:36:13.979694 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84189d7_9972_420e_84cf_42fd69638c86.slice/crio-f7e8f2a06b45943cad4c20fb1ec234cfe144b1e274744794a53b886ebb70eec3 WatchSource:0}: Error finding container f7e8f2a06b45943cad4c20fb1ec234cfe144b1e274744794a53b886ebb70eec3: Status 404 returned error can't find the container with id f7e8f2a06b45943cad4c20fb1ec234cfe144b1e274744794a53b886ebb70eec3 Jul 07 15:36:14.698634 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.698603 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt"] Jul 07 15:36:14.701233 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.701209 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.706144 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.706091 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xdtl5\"" Jul 07 15:36:14.706312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.706187 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 15:36:14.706312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.706206 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 15:36:14.706312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.706226 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 15:36:14.706312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.706230 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 15:36:14.720598 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.720570 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt"] Jul 07 15:36:14.785266 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.785226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-token\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.785454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.785313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-cacerts\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.785454 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.785351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2bf76dc-f4d2-432f-a8fe-82816c31f051-local-certs\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.785547 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.785476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.785547 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.785514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x26wc\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-kube-api-access-x26wc\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.785634 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.785586 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.785672 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.785635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.829183 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.829143 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" event={"ID":"d84189d7-9972-420e-84cf-42fd69638c86","Type":"ContainerStarted","Data":"f7e8f2a06b45943cad4c20fb1ec234cfe144b1e274744794a53b886ebb70eec3"} Jul 07 15:36:14.886443 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.886408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.886443 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.886446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.886693 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.886496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-token\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.886693 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.886524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-cacerts\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.886693 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.886562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2bf76dc-f4d2-432f-a8fe-82816c31f051-local-certs\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.886693 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.886597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.886693 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.886629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26wc\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-kube-api-access-x26wc\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.887562 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.887535 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.889051 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.889028 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2bf76dc-f4d2-432f-a8fe-82816c31f051-local-certs\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.889193 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.889037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.889251 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.889199 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.889251 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.889209 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-cacerts\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.895913 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.895892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-token\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:14.896014 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:14.895949 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26wc\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-kube-api-access-x26wc\") pod \"istiod-openshift-gateway-7574459656-r8xzt\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:15.013487 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:15.013400 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:15.172564 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:15.172535 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt"] Jul 07 15:36:15.174079 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:36:15.174047 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2bf76dc_f4d2_432f_a8fe_82816c31f051.slice/crio-616b38527f3259861e215b269dfe643fe55fe6d97d589524d6113949b16dd689 WatchSource:0}: Error finding container 616b38527f3259861e215b269dfe643fe55fe6d97d589524d6113949b16dd689: Status 404 returned error can't find the container with id 616b38527f3259861e215b269dfe643fe55fe6d97d589524d6113949b16dd689 Jul 07 15:36:15.838994 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:15.838916 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" event={"ID":"e2bf76dc-f4d2-432f-a8fe-82816c31f051","Type":"ContainerStarted","Data":"616b38527f3259861e215b269dfe643fe55fe6d97d589524d6113949b16dd689"} Jul 07 15:36:19.223155 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:19.221713 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:36:19.223155 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:19.221797 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 07 15:36:19.863717 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:19.863671 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" event={"ID":"e2bf76dc-f4d2-432f-a8fe-82816c31f051","Type":"ContainerStarted","Data":"acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25"} Jul 07 15:36:19.863928 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:19.863740 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:19.865291 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:19.865258 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" event={"ID":"b0ae57d4-b952-4853-ad0b-f151f4c12b3d","Type":"ContainerStarted","Data":"b766536db328ca87e3376d111a5b02bbc872ef084c46ede317237753c91cf88b"} Jul 07 15:36:19.866663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:19.866639 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" event={"ID":"d84189d7-9972-420e-84cf-42fd69638c86","Type":"ContainerStarted","Data":"7b9568550cf3f977746fd05d98569957a17e6fbf52be032806fb29f1d0139bdc"} Jul 07 15:36:19.866793 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:19.866774 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:19.972540 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:19.972484 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" podStartSLOduration=1.927180076 podStartE2EDuration="5.972466246s" totalImagesPullingTime="4.04528617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:19.962347706 +0000 UTC m=+413.385066940" watchObservedRunningTime="2026-07-07 15:36:19.972466246 +0000 UTC m=+413.395185479" Jul 07 15:36:20.053979 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:20.053917 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-tb47h" podStartSLOduration=1.944007251 podStartE2EDuration="8.053899916s" totalImagesPullingTime="6.109892665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:20.052471621 +0000 UTC m=+413.475190855" watchObservedRunningTime="2026-07-07 15:36:20.053899916 +0000 UTC m=+413.476619151" Jul 07 15:36:20.133387 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:20.133270 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" podStartSLOduration=2.854286292 podStartE2EDuration="8.133245842s" totalImagesPullingTime="5.27895955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:20.133069807 +0000 UTC m=+413.555789042" watchObservedRunningTime="2026-07-07 15:36:20.133245842 +0000 UTC m=+413.555965077" Jul 07 15:36:20.873450 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:20.873422 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:22.768316 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.768280 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd"] Jul 07 15:36:22.770623 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.770597 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.779837 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.779815 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jqfzg\"" Jul 07 15:36:22.779837 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.779833 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 15:36:22.781800 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.781785 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 15:36:22.781944 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.781931 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 15:36:22.798482 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.798441 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd"] Jul 07 15:36:22.863301 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.863258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4fwp\" (UniqueName: \"kubernetes.io/projected/fe699c8c-fca1-4eae-97fa-02389f613083-kube-api-access-m4fwp\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.863462 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.863310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fe699c8c-fca1-4eae-97fa-02389f613083-manager-config\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.863462 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.863359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe699c8c-fca1-4eae-97fa-02389f613083-cert\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.863462 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.863448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe699c8c-fca1-4eae-97fa-02389f613083-metrics-cert\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.963891 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.963849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe699c8c-fca1-4eae-97fa-02389f613083-metrics-cert\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.964088 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.963937 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4fwp\" (UniqueName: \"kubernetes.io/projected/fe699c8c-fca1-4eae-97fa-02389f613083-kube-api-access-m4fwp\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.964088 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.963992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fe699c8c-fca1-4eae-97fa-02389f613083-manager-config\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.964088 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.964022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe699c8c-fca1-4eae-97fa-02389f613083-cert\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.964710 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.964690 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fe699c8c-fca1-4eae-97fa-02389f613083-manager-config\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.966595 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.966579 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe699c8c-fca1-4eae-97fa-02389f613083-cert\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.966644 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.966626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe699c8c-fca1-4eae-97fa-02389f613083-metrics-cert\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:22.987205 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:22.987173 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4fwp\" (UniqueName: \"kubernetes.io/projected/fe699c8c-fca1-4eae-97fa-02389f613083-kube-api-access-m4fwp\") pod \"lws-controller-manager-7fb8c6bffd-9gcnd\" (UID: \"fe699c8c-fca1-4eae-97fa-02389f613083\") " pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:23.079773 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:23.079687 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:23.245400 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:23.245370 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd"] Jul 07 15:36:23.245550 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:36:23.245373 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe699c8c_fca1_4eae_97fa_02389f613083.slice/crio-19f0edff69851b55d1967ff6a01b43683e18e1750edeeaabf0cad0a8f1ad9328 WatchSource:0}: Error finding container 19f0edff69851b55d1967ff6a01b43683e18e1750edeeaabf0cad0a8f1ad9328: Status 404 returned error can't find the container with id 19f0edff69851b55d1967ff6a01b43683e18e1750edeeaabf0cad0a8f1ad9328 Jul 07 15:36:23.886050 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:23.886011 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" event={"ID":"fe699c8c-fca1-4eae-97fa-02389f613083","Type":"ContainerStarted","Data":"19f0edff69851b55d1967ff6a01b43683e18e1750edeeaabf0cad0a8f1ad9328"} Jul 07 15:36:24.888193 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:24.888155 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt"] Jul 07 15:36:24.888610 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:24.888343 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" podUID="e2bf76dc-f4d2-432f-a8fe-82816c31f051" containerName="discovery" containerID="cri-o://acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25" gracePeriod=30 Jul 07 15:36:24.893158 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:24.893098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" event={"ID":"fe699c8c-fca1-4eae-97fa-02389f613083","Type":"ContainerStarted","Data":"c6539e5fa8d9ed0bf75109226161386273a34b49cb5077bd17e49ff1d5f6e681"} Jul 07 15:36:24.893315 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:24.893192 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:36:25.068681 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.068537 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" podStartSLOduration=1.585178129 podStartE2EDuration="3.068515739s" totalImagesPullingTime="1.48333761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:25.066365889 +0000 UTC m=+418.489085123" watchObservedRunningTime="2026-07-07 15:36:25.068515739 +0000 UTC m=+418.491234973" Jul 07 15:36:25.139774 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.139751 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:25.289848 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.289761 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-token\") pod \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " Jul 07 15:36:25.289848 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.289839 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-ca-configmap\") pod \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " Jul 07 15:36:25.290071 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.289869 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-dns-cert\") pod \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " Jul 07 15:36:25.290071 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.289903 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2bf76dc-f4d2-432f-a8fe-82816c31f051-local-certs\") pod \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " Jul 07 15:36:25.290071 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.289930 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x26wc\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-kube-api-access-x26wc\") pod \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " Jul 07 15:36:25.290071 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.289956 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-cacerts\") pod \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " Jul 07 15:36:25.290071 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.289998 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-kubeconfig\") pod \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\" (UID: \"e2bf76dc-f4d2-432f-a8fe-82816c31f051\") " Jul 07 15:36:25.290361 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.290319 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e2bf76dc-f4d2-432f-a8fe-82816c31f051" (UID: "e2bf76dc-f4d2-432f-a8fe-82816c31f051"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:36:25.292649 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.292620 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2bf76dc-f4d2-432f-a8fe-82816c31f051-local-certs" (OuterVolumeSpecName: "local-certs") pod "e2bf76dc-f4d2-432f-a8fe-82816c31f051" (UID: "e2bf76dc-f4d2-432f-a8fe-82816c31f051"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:36:25.292775 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.292650 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e2bf76dc-f4d2-432f-a8fe-82816c31f051" (UID: "e2bf76dc-f4d2-432f-a8fe-82816c31f051"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:36:25.292884 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.292850 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2bf76dc-f4d2-432f-a8fe-82816c31f051" (UID: "e2bf76dc-f4d2-432f-a8fe-82816c31f051"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:36:25.293052 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.292913 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-cacerts" (OuterVolumeSpecName: "cacerts") pod "e2bf76dc-f4d2-432f-a8fe-82816c31f051" (UID: "e2bf76dc-f4d2-432f-a8fe-82816c31f051"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:36:25.293052 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.292977 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e2bf76dc-f4d2-432f-a8fe-82816c31f051" (UID: "e2bf76dc-f4d2-432f-a8fe-82816c31f051"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:36:25.293052 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.292987 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-kube-api-access-x26wc" (OuterVolumeSpecName: "kube-api-access-x26wc") pod "e2bf76dc-f4d2-432f-a8fe-82816c31f051" (UID: "e2bf76dc-f4d2-432f-a8fe-82816c31f051"). InnerVolumeSpecName "kube-api-access-x26wc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:36:25.391094 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.391056 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-ca-configmap\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:36:25.391094 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.391085 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-csr-dns-cert\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:36:25.391094 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.391095 2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2bf76dc-f4d2-432f-a8fe-82816c31f051-local-certs\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:36:25.391094 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.391104 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x26wc\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-kube-api-access-x26wc\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:36:25.391380 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.391112 2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-cacerts\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:36:25.391380 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.391133 2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-kubeconfig\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:36:25.391380 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.391142 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2bf76dc-f4d2-432f-a8fe-82816c31f051-istio-token\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:36:25.899530 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.899500 2561 generic.go:356] "Generic (PLEG): container finished" podID="e2bf76dc-f4d2-432f-a8fe-82816c31f051" containerID="acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25" exitCode=0 Jul 07 15:36:25.899954 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.899554 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" Jul 07 15:36:25.899954 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.899588 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" event={"ID":"e2bf76dc-f4d2-432f-a8fe-82816c31f051","Type":"ContainerDied","Data":"acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25"} Jul 07 15:36:25.899954 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.899637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt" event={"ID":"e2bf76dc-f4d2-432f-a8fe-82816c31f051","Type":"ContainerDied","Data":"616b38527f3259861e215b269dfe643fe55fe6d97d589524d6113949b16dd689"} Jul 07 15:36:25.899954 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.899658 2561 scope.go:117] "RemoveContainer" containerID="acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25" Jul 07 15:36:25.912626 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.912600 2561 scope.go:117] "RemoveContainer" containerID="acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25" Jul 07 15:36:25.912912 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:36:25.912893 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25\": container with ID starting with acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25 not found: ID does not exist" containerID="acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25" Jul 07 15:36:25.912971 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.912921 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25"} err="failed to get container status \"acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25\": rpc error: code = NotFound desc = could not find container \"acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25\": container with ID starting with acdbade7954a9778d07c2984832402ff88b8e6bba966a7231b21d3b69420fd25 not found: ID does not exist" Jul 07 15:36:25.934814 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.934775 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt"] Jul 07 15:36:25.960098 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:25.960066 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r8xzt"] Jul 07 15:36:27.168392 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:27.168354 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2bf76dc-f4d2-432f-a8fe-82816c31f051" path="/var/lib/kubelet/pods/e2bf76dc-f4d2-432f-a8fe-82816c31f051/volumes" Jul 07 15:36:30.873821 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:30.873793 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nfxv4" Jul 07 15:36:35.901774 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:36:35.901746 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fb8c6bffd-9gcnd" Jul 07 15:37:28.553090 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.553052 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn"] Jul 07 15:37:28.553594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.553385 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2bf76dc-f4d2-432f-a8fe-82816c31f051" containerName="discovery" Jul 07 15:37:28.553594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.553397 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2bf76dc-f4d2-432f-a8fe-82816c31f051" containerName="discovery" Jul 07 15:37:28.553594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.553449 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2bf76dc-f4d2-432f-a8fe-82816c31f051" containerName="discovery" Jul 07 15:37:28.555915 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.555900 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.558848 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.558824 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 15:37:28.558966 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.558863 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f2wlw\"" Jul 07 15:37:28.559906 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.559890 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 15:37:28.568357 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.568335 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn"] Jul 07 15:37:28.721555 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.721516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.721555 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.721558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.721782 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.721584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwf7n\" (UniqueName: \"kubernetes.io/projected/bdce1042-8a7a-481f-8a96-5479fff35f27-kube-api-access-vwf7n\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.823040 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.822936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.823040 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.822999 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.823040 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.823024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwf7n\" (UniqueName: \"kubernetes.io/projected/bdce1042-8a7a-481f-8a96-5479fff35f27-kube-api-access-vwf7n\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.823430 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.823410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.823474 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.823421 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.833981 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.833948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwf7n\" (UniqueName: \"kubernetes.io/projected/bdce1042-8a7a-481f-8a96-5479fff35f27-kube-api-access-vwf7n\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.864894 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.864856 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:28.999309 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:28.999255 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn"] Jul 07 15:37:29.001642 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:37:29.001608 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdce1042_8a7a_481f_8a96_5479fff35f27.slice/crio-fd8c82c32ba0cf5b7e1bef8815709dbcd46752a9825bff58c117047245712c93 WatchSource:0}: Error finding container fd8c82c32ba0cf5b7e1bef8815709dbcd46752a9825bff58c117047245712c93: Status 404 returned error can't find the container with id fd8c82c32ba0cf5b7e1bef8815709dbcd46752a9825bff58c117047245712c93 Jul 07 15:37:29.192662 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.192627 2561 generic.go:356] "Generic (PLEG): container finished" podID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerID="93379aaad1d3044b572ff264922f444c600e00a3483e0bfffc2babfd43c0f58a" exitCode=0 Jul 07 15:37:29.192840 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.192716 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" event={"ID":"bdce1042-8a7a-481f-8a96-5479fff35f27","Type":"ContainerDied","Data":"93379aaad1d3044b572ff264922f444c600e00a3483e0bfffc2babfd43c0f58a"} Jul 07 15:37:29.192840 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.192759 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" event={"ID":"bdce1042-8a7a-481f-8a96-5479fff35f27","Type":"ContainerStarted","Data":"fd8c82c32ba0cf5b7e1bef8815709dbcd46752a9825bff58c117047245712c93"} Jul 07 15:37:29.358572 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.358495 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k"] Jul 07 15:37:29.361091 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.361076 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.372470 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.372447 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k"] Jul 07 15:37:29.527461 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.527420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxslj\" (UniqueName: \"kubernetes.io/projected/68deb6dc-a916-4fcb-b9e4-8500af143ce6-kube-api-access-fxslj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.527661 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.527476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.527661 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.527537 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.628565 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.628478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxslj\" (UniqueName: \"kubernetes.io/projected/68deb6dc-a916-4fcb-b9e4-8500af143ce6-kube-api-access-fxslj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.628565 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.628532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.628565 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.628555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.629029 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.628856 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.629029 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.628890 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.638145 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.638094 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxslj\" (UniqueName: \"kubernetes.io/projected/68deb6dc-a916-4fcb-b9e4-8500af143ce6-kube-api-access-fxslj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.669733 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.669702 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:29.746390 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.746353 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt"] Jul 07 15:37:29.749083 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.749064 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:29.763701 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.763635 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt"] Jul 07 15:37:29.808322 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.808299 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k"] Jul 07 15:37:29.809689 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:37:29.809665 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68deb6dc_a916_4fcb_b9e4_8500af143ce6.slice/crio-4ff0af4db114c0a654c424df3bee8ed9a69abac9fc25247d163e76a8178af810 WatchSource:0}: Error finding container 4ff0af4db114c0a654c424df3bee8ed9a69abac9fc25247d163e76a8178af810: Status 404 returned error can't find the container with id 4ff0af4db114c0a654c424df3bee8ed9a69abac9fc25247d163e76a8178af810 Jul 07 15:37:29.930864 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.930839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:29.930999 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.930874 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2qjh\" (UniqueName: \"kubernetes.io/projected/a4e6ab1c-2451-4f47-9059-3302b94f0d45-kube-api-access-w2qjh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:29.930999 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:29.930906 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:30.031510 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.031475 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qjh\" (UniqueName: \"kubernetes.io/projected/a4e6ab1c-2451-4f47-9059-3302b94f0d45-kube-api-access-w2qjh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:30.031679 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.031536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:30.031679 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.031622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:30.032000 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.031970 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:30.032111 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.032015 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:30.045790 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.045762 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qjh\" (UniqueName: \"kubernetes.io/projected/a4e6ab1c-2451-4f47-9059-3302b94f0d45-kube-api-access-w2qjh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:30.060226 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.060176 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:30.170748 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.170665 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh"] Jul 07 15:37:30.181172 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.181139 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.187802 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.187775 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh"] Jul 07 15:37:30.200588 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.200558 2561 generic.go:356] "Generic (PLEG): container finished" podID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerID="a9d35486f4188c93dd92a94b303290dbabe9b3286c8f9e26fe81588c9d1f5b39" exitCode=0 Jul 07 15:37:30.200758 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.200628 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" event={"ID":"bdce1042-8a7a-481f-8a96-5479fff35f27","Type":"ContainerDied","Data":"a9d35486f4188c93dd92a94b303290dbabe9b3286c8f9e26fe81588c9d1f5b39"} Jul 07 15:37:30.202175 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.202077 2561 generic.go:356] "Generic (PLEG): container finished" podID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerID="6642fd985afd75253a0c0e598df19b7456dd290e871b0a2956df27540e1b4900" exitCode=0 Jul 07 15:37:30.202175 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.202106 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" event={"ID":"68deb6dc-a916-4fcb-b9e4-8500af143ce6","Type":"ContainerDied","Data":"6642fd985afd75253a0c0e598df19b7456dd290e871b0a2956df27540e1b4900"} Jul 07 15:37:30.202175 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.202165 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" event={"ID":"68deb6dc-a916-4fcb-b9e4-8500af143ce6","Type":"ContainerStarted","Data":"4ff0af4db114c0a654c424df3bee8ed9a69abac9fc25247d163e76a8178af810"} Jul 07 15:37:30.209069 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.209050 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt"] Jul 07 15:37:30.235056 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:37:30.235029 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e6ab1c_2451_4f47_9059_3302b94f0d45.slice/crio-9be6107401c5763c52720a0f53e17aaa6149a20dd9a0372f0698ae77b2b8771a WatchSource:0}: Error finding container 9be6107401c5763c52720a0f53e17aaa6149a20dd9a0372f0698ae77b2b8771a: Status 404 returned error can't find the container with id 9be6107401c5763c52720a0f53e17aaa6149a20dd9a0372f0698ae77b2b8771a Jul 07 15:37:30.334282 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.334248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.334401 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.334359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.334401 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.334377 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxnp8\" (UniqueName: \"kubernetes.io/projected/04bee174-3c80-44a6-ba2c-c20f603eb5b3-kube-api-access-bxnp8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.435702 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.435620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.435702 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.435695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.435870 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.435714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnp8\" (UniqueName: \"kubernetes.io/projected/04bee174-3c80-44a6-ba2c-c20f603eb5b3-kube-api-access-bxnp8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.436025 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.436004 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.436063 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.436026 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.445236 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.445208 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnp8\" (UniqueName: \"kubernetes.io/projected/04bee174-3c80-44a6-ba2c-c20f603eb5b3-kube-api-access-bxnp8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.554537 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.554500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:30.696312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:30.696288 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh"] Jul 07 15:37:30.698057 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:37:30.698031 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04bee174_3c80_44a6_ba2c_c20f603eb5b3.slice/crio-907e71b35ee9c2739dd4fe92d414c1ebc88234cfc20c161bf18d35953bab9d28 WatchSource:0}: Error finding container 907e71b35ee9c2739dd4fe92d414c1ebc88234cfc20c161bf18d35953bab9d28: Status 404 returned error can't find the container with id 907e71b35ee9c2739dd4fe92d414c1ebc88234cfc20c161bf18d35953bab9d28 Jul 07 15:37:31.209081 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:31.209050 2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerID="c2aa363f0c947b9d1c8e8187e9a469cc5db1f32f724ce5ea25f1df1d24856869" exitCode=0 Jul 07 15:37:31.209260 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:31.209161 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" event={"ID":"a4e6ab1c-2451-4f47-9059-3302b94f0d45","Type":"ContainerDied","Data":"c2aa363f0c947b9d1c8e8187e9a469cc5db1f32f724ce5ea25f1df1d24856869"} Jul 07 15:37:31.209260 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:31.209220 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" event={"ID":"a4e6ab1c-2451-4f47-9059-3302b94f0d45","Type":"ContainerStarted","Data":"9be6107401c5763c52720a0f53e17aaa6149a20dd9a0372f0698ae77b2b8771a"} Jul 07 15:37:31.211642 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:31.211516 2561 generic.go:356] "Generic (PLEG): container finished" podID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerID="18dc3d64d50e6b55cbb39f02ca08012948db01f0038a937f2f97f481c41fe325" exitCode=0 Jul 07 15:37:31.211642 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:31.211609 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" event={"ID":"bdce1042-8a7a-481f-8a96-5479fff35f27","Type":"ContainerDied","Data":"18dc3d64d50e6b55cbb39f02ca08012948db01f0038a937f2f97f481c41fe325"} Jul 07 15:37:31.213027 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:31.213006 2561 generic.go:356] "Generic (PLEG): container finished" podID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerID="b72d32108552b7e5cefbbfbc12312d362f28bc98acfb5bfab483a15aa18e1820" exitCode=0 Jul 07 15:37:31.213112 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:31.213036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" event={"ID":"04bee174-3c80-44a6-ba2c-c20f603eb5b3","Type":"ContainerDied","Data":"b72d32108552b7e5cefbbfbc12312d362f28bc98acfb5bfab483a15aa18e1820"} Jul 07 15:37:31.213112 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:31.213071 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" event={"ID":"04bee174-3c80-44a6-ba2c-c20f603eb5b3","Type":"ContainerStarted","Data":"907e71b35ee9c2739dd4fe92d414c1ebc88234cfc20c161bf18d35953bab9d28"} Jul 07 15:37:32.219042 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.219016 2561 generic.go:356] "Generic (PLEG): container finished" podID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerID="072004c6f7b27685d92677bf9066614facd342d28151c5b6e381c5c878cb8ae7" exitCode=0 Jul 07 15:37:32.219407 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.219100 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" event={"ID":"68deb6dc-a916-4fcb-b9e4-8500af143ce6","Type":"ContainerDied","Data":"072004c6f7b27685d92677bf9066614facd342d28151c5b6e381c5c878cb8ae7"} Jul 07 15:37:32.220856 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.220832 2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerID="b3ae2d91add09c5a7526189ca9ba352bb8bcd18c32ac89ba9cc3cd3fd730a962" exitCode=0 Jul 07 15:37:32.220944 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.220920 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" event={"ID":"a4e6ab1c-2451-4f47-9059-3302b94f0d45","Type":"ContainerDied","Data":"b3ae2d91add09c5a7526189ca9ba352bb8bcd18c32ac89ba9cc3cd3fd730a962"} Jul 07 15:37:32.344783 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.344759 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:32.454442 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.454414 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwf7n\" (UniqueName: \"kubernetes.io/projected/bdce1042-8a7a-481f-8a96-5479fff35f27-kube-api-access-vwf7n\") pod \"bdce1042-8a7a-481f-8a96-5479fff35f27\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " Jul 07 15:37:32.454554 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.454472 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-util\") pod \"bdce1042-8a7a-481f-8a96-5479fff35f27\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " Jul 07 15:37:32.454554 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.454505 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-bundle\") pod \"bdce1042-8a7a-481f-8a96-5479fff35f27\" (UID: \"bdce1042-8a7a-481f-8a96-5479fff35f27\") " Jul 07 15:37:32.455186 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.455160 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-bundle" (OuterVolumeSpecName: "bundle") pod "bdce1042-8a7a-481f-8a96-5479fff35f27" (UID: "bdce1042-8a7a-481f-8a96-5479fff35f27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:37:32.457167 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.457147 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdce1042-8a7a-481f-8a96-5479fff35f27-kube-api-access-vwf7n" (OuterVolumeSpecName: "kube-api-access-vwf7n") pod "bdce1042-8a7a-481f-8a96-5479fff35f27" (UID: "bdce1042-8a7a-481f-8a96-5479fff35f27"). InnerVolumeSpecName "kube-api-access-vwf7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:37:32.461091 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.461069 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-util" (OuterVolumeSpecName: "util") pod "bdce1042-8a7a-481f-8a96-5479fff35f27" (UID: "bdce1042-8a7a-481f-8a96-5479fff35f27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:37:32.556009 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.555928 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwf7n\" (UniqueName: \"kubernetes.io/projected/bdce1042-8a7a-481f-8a96-5479fff35f27-kube-api-access-vwf7n\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:32.556009 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.555955 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-util\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:32.556009 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:32.555966 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdce1042-8a7a-481f-8a96-5479fff35f27-bundle\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:33.227371 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:33.227345 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" Jul 07 15:37:33.227371 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:33.227340 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn" event={"ID":"bdce1042-8a7a-481f-8a96-5479fff35f27","Type":"ContainerDied","Data":"fd8c82c32ba0cf5b7e1bef8815709dbcd46752a9825bff58c117047245712c93"} Jul 07 15:37:33.227831 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:33.227412 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd8c82c32ba0cf5b7e1bef8815709dbcd46752a9825bff58c117047245712c93" Jul 07 15:37:33.229802 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:33.229778 2561 generic.go:356] "Generic (PLEG): container finished" podID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerID="45f9972ba480ed1b20b78add1281d30dc6f22f70b4d84ee7959d23eb7fc1d265" exitCode=0 Jul 07 15:37:33.229896 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:33.229805 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" event={"ID":"68deb6dc-a916-4fcb-b9e4-8500af143ce6","Type":"ContainerDied","Data":"45f9972ba480ed1b20b78add1281d30dc6f22f70b4d84ee7959d23eb7fc1d265"} Jul 07 15:37:33.231525 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:33.231507 2561 generic.go:356] "Generic (PLEG): container finished" podID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerID="2ae4b537b334d8e874676324b440e757689a2b54bf44949e590fdbde163418b0" exitCode=0 Jul 07 15:37:33.231605 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:33.231589 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" event={"ID":"04bee174-3c80-44a6-ba2c-c20f603eb5b3","Type":"ContainerDied","Data":"2ae4b537b334d8e874676324b440e757689a2b54bf44949e590fdbde163418b0"} Jul 07 15:37:33.233703 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:33.233661 2561 generic.go:356] "Generic (PLEG): container finished" podID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerID="2216b11224266f6332cb90d2ed8f3a32368655ad23edc6d67fb6f4d296523dac" exitCode=0 Jul 07 15:37:33.233833 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:33.233816 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" event={"ID":"a4e6ab1c-2451-4f47-9059-3302b94f0d45","Type":"ContainerDied","Data":"2216b11224266f6332cb90d2ed8f3a32368655ad23edc6d67fb6f4d296523dac"} Jul 07 15:37:34.240751 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.240709 2561 generic.go:356] "Generic (PLEG): container finished" podID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerID="f196ffa4a66086b0f81f263208ff28c0b12424e81e41709a0a47a2c32b113ded" exitCode=0 Jul 07 15:37:34.241244 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.240800 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" event={"ID":"04bee174-3c80-44a6-ba2c-c20f603eb5b3","Type":"ContainerDied","Data":"f196ffa4a66086b0f81f263208ff28c0b12424e81e41709a0a47a2c32b113ded"} Jul 07 15:37:34.395565 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.395541 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:34.403132 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.403103 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:34.574046 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.573951 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-bundle\") pod \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " Jul 07 15:37:34.574046 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.574026 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2qjh\" (UniqueName: \"kubernetes.io/projected/a4e6ab1c-2451-4f47-9059-3302b94f0d45-kube-api-access-w2qjh\") pod \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " Jul 07 15:37:34.574315 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.574068 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxslj\" (UniqueName: \"kubernetes.io/projected/68deb6dc-a916-4fcb-b9e4-8500af143ce6-kube-api-access-fxslj\") pod \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " Jul 07 15:37:34.574315 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.574091 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-bundle\") pod \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " Jul 07 15:37:34.574315 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.574275 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-util\") pod \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\" (UID: \"68deb6dc-a916-4fcb-b9e4-8500af143ce6\") " Jul 07 15:37:34.574472 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.574321 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-util\") pod \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\" (UID: \"a4e6ab1c-2451-4f47-9059-3302b94f0d45\") " Jul 07 15:37:34.574663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.574637 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-bundle" (OuterVolumeSpecName: "bundle") pod "a4e6ab1c-2451-4f47-9059-3302b94f0d45" (UID: "a4e6ab1c-2451-4f47-9059-3302b94f0d45"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:37:34.574839 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.574811 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-bundle" (OuterVolumeSpecName: "bundle") pod "68deb6dc-a916-4fcb-b9e4-8500af143ce6" (UID: "68deb6dc-a916-4fcb-b9e4-8500af143ce6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:37:34.576791 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.576759 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4e6ab1c-2451-4f47-9059-3302b94f0d45-kube-api-access-w2qjh" (OuterVolumeSpecName: "kube-api-access-w2qjh") pod "a4e6ab1c-2451-4f47-9059-3302b94f0d45" (UID: "a4e6ab1c-2451-4f47-9059-3302b94f0d45"). InnerVolumeSpecName "kube-api-access-w2qjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:37:34.576894 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.576784 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68deb6dc-a916-4fcb-b9e4-8500af143ce6-kube-api-access-fxslj" (OuterVolumeSpecName: "kube-api-access-fxslj") pod "68deb6dc-a916-4fcb-b9e4-8500af143ce6" (UID: "68deb6dc-a916-4fcb-b9e4-8500af143ce6"). InnerVolumeSpecName "kube-api-access-fxslj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:37:34.581011 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.580972 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-util" (OuterVolumeSpecName: "util") pod "68deb6dc-a916-4fcb-b9e4-8500af143ce6" (UID: "68deb6dc-a916-4fcb-b9e4-8500af143ce6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:37:34.581439 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.581421 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-util" (OuterVolumeSpecName: "util") pod "a4e6ab1c-2451-4f47-9059-3302b94f0d45" (UID: "a4e6ab1c-2451-4f47-9059-3302b94f0d45"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:37:34.675219 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.675180 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2qjh\" (UniqueName: \"kubernetes.io/projected/a4e6ab1c-2451-4f47-9059-3302b94f0d45-kube-api-access-w2qjh\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:34.675219 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.675209 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxslj\" (UniqueName: \"kubernetes.io/projected/68deb6dc-a916-4fcb-b9e4-8500af143ce6-kube-api-access-fxslj\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:34.675219 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.675219 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-bundle\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:34.675219 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.675229 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/68deb6dc-a916-4fcb-b9e4-8500af143ce6-util\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:34.675468 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.675237 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-util\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:34.675468 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:34.675244 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4e6ab1c-2451-4f47-9059-3302b94f0d45-bundle\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:35.248063 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.248037 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" Jul 07 15:37:35.248505 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.248037 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k" event={"ID":"68deb6dc-a916-4fcb-b9e4-8500af143ce6","Type":"ContainerDied","Data":"4ff0af4db114c0a654c424df3bee8ed9a69abac9fc25247d163e76a8178af810"} Jul 07 15:37:35.248505 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.248171 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ff0af4db114c0a654c424df3bee8ed9a69abac9fc25247d163e76a8178af810" Jul 07 15:37:35.250441 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.250099 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" Jul 07 15:37:35.250441 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.250168 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt" event={"ID":"a4e6ab1c-2451-4f47-9059-3302b94f0d45","Type":"ContainerDied","Data":"9be6107401c5763c52720a0f53e17aaa6149a20dd9a0372f0698ae77b2b8771a"} Jul 07 15:37:35.250441 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.250281 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9be6107401c5763c52720a0f53e17aaa6149a20dd9a0372f0698ae77b2b8771a" Jul 07 15:37:35.394944 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.394915 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:35.480979 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.480890 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-util\") pod \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " Jul 07 15:37:35.480979 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.480966 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-bundle\") pod \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " Jul 07 15:37:35.481213 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.481014 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxnp8\" (UniqueName: \"kubernetes.io/projected/04bee174-3c80-44a6-ba2c-c20f603eb5b3-kube-api-access-bxnp8\") pod \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\" (UID: \"04bee174-3c80-44a6-ba2c-c20f603eb5b3\") " Jul 07 15:37:35.481510 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.481486 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-bundle" (OuterVolumeSpecName: "bundle") pod "04bee174-3c80-44a6-ba2c-c20f603eb5b3" (UID: "04bee174-3c80-44a6-ba2c-c20f603eb5b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:37:35.483236 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.483196 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04bee174-3c80-44a6-ba2c-c20f603eb5b3-kube-api-access-bxnp8" (OuterVolumeSpecName: "kube-api-access-bxnp8") pod "04bee174-3c80-44a6-ba2c-c20f603eb5b3" (UID: "04bee174-3c80-44a6-ba2c-c20f603eb5b3"). InnerVolumeSpecName "kube-api-access-bxnp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:37:35.486489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.486466 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-util" (OuterVolumeSpecName: "util") pod "04bee174-3c80-44a6-ba2c-c20f603eb5b3" (UID: "04bee174-3c80-44a6-ba2c-c20f603eb5b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:37:35.582245 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.582194 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxnp8\" (UniqueName: \"kubernetes.io/projected/04bee174-3c80-44a6-ba2c-c20f603eb5b3-kube-api-access-bxnp8\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:35.582245 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.582240 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-util\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:35.582245 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:35.582251 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04bee174-3c80-44a6-ba2c-c20f603eb5b3-bundle\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:37:36.256711 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:36.256683 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" Jul 07 15:37:36.257098 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:36.256683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh" event={"ID":"04bee174-3c80-44a6-ba2c-c20f603eb5b3","Type":"ContainerDied","Data":"907e71b35ee9c2739dd4fe92d414c1ebc88234cfc20c161bf18d35953bab9d28"} Jul 07 15:37:36.257098 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:37:36.256789 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="907e71b35ee9c2739dd4fe92d414c1ebc88234cfc20c161bf18d35953bab9d28" Jul 07 15:38:00.537217 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537179 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk"] Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537506 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerName="util" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537517 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerName="util" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537526 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerName="pull" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537531 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerName="pull" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537537 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerName="pull" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537543 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerName="pull" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537550 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerName="extract" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537555 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerName="extract" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537565 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerName="pull" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537570 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerName="pull" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537578 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerName="extract" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537582 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerName="extract" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537589 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerName="util" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537594 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerName="util" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537603 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerName="util" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537608 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerName="util" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537613 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerName="extract" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537618 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerName="extract" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537624 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerName="extract" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537628 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerName="extract" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537637 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerName="pull" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537643 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerName="pull" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537649 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerName="util" Jul 07 15:38:00.537663 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537654 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerName="util" Jul 07 15:38:00.538415 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537702 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdce1042-8a7a-481f-8a96-5479fff35f27" containerName="extract" Jul 07 15:38:00.538415 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537709 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4e6ab1c-2451-4f47-9059-3302b94f0d45" containerName="extract" Jul 07 15:38:00.538415 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537715 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="68deb6dc-a916-4fcb-b9e4-8500af143ce6" containerName="extract" Jul 07 15:38:00.538415 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.537723 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="04bee174-3c80-44a6-ba2c-c20f603eb5b3" containerName="extract" Jul 07 15:38:00.540630 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.540613 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:00.543439 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.543409 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 15:38:00.544315 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.544294 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 15:38:00.544521 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.544505 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 15:38:00.544574 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.544535 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f2wlw\"" Jul 07 15:38:00.545307 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.545293 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 15:38:00.550706 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.550678 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk"] Jul 07 15:38:00.599133 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.599074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bfdfa166-28a2-4e48-b61c-08791a0e15b0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:00.599332 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.599165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfdfa166-28a2-4e48-b61c-08791a0e15b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:00.599332 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.599282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdf4t\" (UniqueName: \"kubernetes.io/projected/bfdfa166-28a2-4e48-b61c-08791a0e15b0-kube-api-access-fdf4t\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:00.699808 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.699765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdf4t\" (UniqueName: \"kubernetes.io/projected/bfdfa166-28a2-4e48-b61c-08791a0e15b0-kube-api-access-fdf4t\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:00.700008 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.699852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bfdfa166-28a2-4e48-b61c-08791a0e15b0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:00.700008 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.699882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfdfa166-28a2-4e48-b61c-08791a0e15b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:00.700165 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:38:00.700019 2561 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 07 15:38:00.700165 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:38:00.700093 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfdfa166-28a2-4e48-b61c-08791a0e15b0-plugin-serving-cert podName:bfdfa166-28a2-4e48-b61c-08791a0e15b0 nodeName:}" failed. No retries permitted until 2026-07-07 15:38:01.200071424 +0000 UTC m=+514.622790638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/bfdfa166-28a2-4e48-b61c-08791a0e15b0-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-vvpsk" (UID: "bfdfa166-28a2-4e48-b61c-08791a0e15b0") : secret "plugin-serving-cert" not found Jul 07 15:38:00.700587 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.700563 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bfdfa166-28a2-4e48-b61c-08791a0e15b0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:00.715174 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:00.715142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdf4t\" (UniqueName: \"kubernetes.io/projected/bfdfa166-28a2-4e48-b61c-08791a0e15b0-kube-api-access-fdf4t\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:01.203504 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:01.203463 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfdfa166-28a2-4e48-b61c-08791a0e15b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:01.206010 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:01.205979 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfdfa166-28a2-4e48-b61c-08791a0e15b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vvpsk\" (UID: \"bfdfa166-28a2-4e48-b61c-08791a0e15b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:01.450146 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:01.450088 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" Jul 07 15:38:01.602376 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:01.602342 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk"] Jul 07 15:38:01.605716 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:38:01.605687 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfdfa166_28a2_4e48_b61c_08791a0e15b0.slice/crio-51d46d83188a821310393f080dd416b6e851ed7f65979e7e46e56147d7532329 WatchSource:0}: Error finding container 51d46d83188a821310393f080dd416b6e851ed7f65979e7e46e56147d7532329: Status 404 returned error can't find the container with id 51d46d83188a821310393f080dd416b6e851ed7f65979e7e46e56147d7532329 Jul 07 15:38:02.387798 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:02.387753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" event={"ID":"bfdfa166-28a2-4e48-b61c-08791a0e15b0","Type":"ContainerStarted","Data":"51d46d83188a821310393f080dd416b6e851ed7f65979e7e46e56147d7532329"} Jul 07 15:38:26.530799 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:26.530765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" event={"ID":"bfdfa166-28a2-4e48-b61c-08791a0e15b0","Type":"ContainerStarted","Data":"fdd9617de73ec7332137afd999fa6e65e40edadef9ebda9bdd89c70af41c2730"} Jul 07 15:38:26.559620 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:26.554984 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vvpsk" podStartSLOduration=2.5992895430000003 podStartE2EDuration="26.554962702s" totalImagesPullingTime="23.955673159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:26.552777986 +0000 UTC m=+539.975497215" watchObservedRunningTime="2026-07-07 15:38:26.554962702 +0000 UTC m=+539.977681939" Jul 07 15:38:54.057785 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.057747 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rlh6s"] Jul 07 15:38:54.085427 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.085388 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rlh6s"] Jul 07 15:38:54.085594 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.085506 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:38:54.088917 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.088895 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 15:38:54.147976 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.147947 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rlh6s"] Jul 07 15:38:54.166997 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.166965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn2jm\" (UniqueName: \"kubernetes.io/projected/daed78bb-a715-4fd5-9dd1-545025bd0b23-kube-api-access-fn2jm\") pod \"limitador-limitador-64c94fd64f-rlh6s\" (UID: \"daed78bb-a715-4fd5-9dd1-545025bd0b23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:38:54.167174 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.167009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daed78bb-a715-4fd5-9dd1-545025bd0b23-config-file\") pod \"limitador-limitador-64c94fd64f-rlh6s\" (UID: \"daed78bb-a715-4fd5-9dd1-545025bd0b23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:38:54.268088 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.268044 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2jm\" (UniqueName: \"kubernetes.io/projected/daed78bb-a715-4fd5-9dd1-545025bd0b23-kube-api-access-fn2jm\") pod \"limitador-limitador-64c94fd64f-rlh6s\" (UID: \"daed78bb-a715-4fd5-9dd1-545025bd0b23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:38:54.268302 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.268098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daed78bb-a715-4fd5-9dd1-545025bd0b23-config-file\") pod \"limitador-limitador-64c94fd64f-rlh6s\" (UID: \"daed78bb-a715-4fd5-9dd1-545025bd0b23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:38:54.268782 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.268763 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daed78bb-a715-4fd5-9dd1-545025bd0b23-config-file\") pod \"limitador-limitador-64c94fd64f-rlh6s\" (UID: \"daed78bb-a715-4fd5-9dd1-545025bd0b23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:38:54.277835 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.277809 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn2jm\" (UniqueName: \"kubernetes.io/projected/daed78bb-a715-4fd5-9dd1-545025bd0b23-kube-api-access-fn2jm\") pod \"limitador-limitador-64c94fd64f-rlh6s\" (UID: \"daed78bb-a715-4fd5-9dd1-545025bd0b23\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:38:54.396005 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.395975 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:38:54.540357 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.540329 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rlh6s"] Jul 07 15:38:54.671242 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.671156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" event={"ID":"daed78bb-a715-4fd5-9dd1-545025bd0b23","Type":"ContainerStarted","Data":"baee8599d31a0acde0f1e003156dfccd50e98a480a16af4d103d52ea4104a628"} Jul 07 15:38:54.873319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.873288 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-x9k7j"] Jul 07 15:38:54.877748 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.877720 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x9k7j" Jul 07 15:38:54.883026 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.882993 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ntfdw\"" Jul 07 15:38:54.893055 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.893025 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-x9k7j"] Jul 07 15:38:54.973463 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:54.973362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m844b\" (UniqueName: \"kubernetes.io/projected/4a23f97c-6a64-4a39-97bf-3e6cc8af39f7-kube-api-access-m844b\") pod \"authorino-58cd955675-x9k7j\" (UID: \"4a23f97c-6a64-4a39-97bf-3e6cc8af39f7\") " pod="kuadrant-system/authorino-58cd955675-x9k7j" Jul 07 15:38:55.074540 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:55.074504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m844b\" (UniqueName: \"kubernetes.io/projected/4a23f97c-6a64-4a39-97bf-3e6cc8af39f7-kube-api-access-m844b\") pod \"authorino-58cd955675-x9k7j\" (UID: \"4a23f97c-6a64-4a39-97bf-3e6cc8af39f7\") " pod="kuadrant-system/authorino-58cd955675-x9k7j" Jul 07 15:38:55.083691 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:55.083662 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m844b\" (UniqueName: \"kubernetes.io/projected/4a23f97c-6a64-4a39-97bf-3e6cc8af39f7-kube-api-access-m844b\") pod \"authorino-58cd955675-x9k7j\" (UID: \"4a23f97c-6a64-4a39-97bf-3e6cc8af39f7\") " pod="kuadrant-system/authorino-58cd955675-x9k7j" Jul 07 15:38:55.187014 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:55.186969 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x9k7j" Jul 07 15:38:55.330932 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:55.330885 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-x9k7j"] Jul 07 15:38:55.333048 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:38:55.333018 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a23f97c_6a64_4a39_97bf_3e6cc8af39f7.slice/crio-64d7b87fe2d9c3758612f82e88ebc66878dac67b94be6bc4b0576a7bbb789bee WatchSource:0}: Error finding container 64d7b87fe2d9c3758612f82e88ebc66878dac67b94be6bc4b0576a7bbb789bee: Status 404 returned error can't find the container with id 64d7b87fe2d9c3758612f82e88ebc66878dac67b94be6bc4b0576a7bbb789bee Jul 07 15:38:55.678704 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:55.678661 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x9k7j" event={"ID":"4a23f97c-6a64-4a39-97bf-3e6cc8af39f7","Type":"ContainerStarted","Data":"64d7b87fe2d9c3758612f82e88ebc66878dac67b94be6bc4b0576a7bbb789bee"} Jul 07 15:38:59.827154 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:38:59.827096 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-x9k7j"] Jul 07 15:39:00.711396 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:00.711364 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" event={"ID":"daed78bb-a715-4fd5-9dd1-545025bd0b23","Type":"ContainerStarted","Data":"96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a"} Jul 07 15:39:00.711602 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:00.711460 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:39:00.712861 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:00.712838 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x9k7j" event={"ID":"4a23f97c-6a64-4a39-97bf-3e6cc8af39f7","Type":"ContainerStarted","Data":"a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd"} Jul 07 15:39:00.735487 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:00.735432 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" podStartSLOduration=1.574176721 podStartE2EDuration="6.735415475s" totalImagesPullingTime="5.161238754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:00.732536531 +0000 UTC m=+574.155255767" watchObservedRunningTime="2026-07-07 15:39:00.735415475 +0000 UTC m=+574.158134708" Jul 07 15:39:00.768418 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:00.768355 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-x9k7j" podStartSLOduration=2.388029788 podStartE2EDuration="6.768338081s" totalImagesPullingTime="4.380308293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:00.766186161 +0000 UTC m=+574.188905395" watchObservedRunningTime="2026-07-07 15:39:00.768338081 +0000 UTC m=+574.191057315" Jul 07 15:39:01.717966 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:01.717926 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-x9k7j" podUID="4a23f97c-6a64-4a39-97bf-3e6cc8af39f7" containerName="authorino" containerID="cri-o://a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd" gracePeriod=30 Jul 07 15:39:01.969422 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:01.969359 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x9k7j" Jul 07 15:39:02.039307 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.039265 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m844b\" (UniqueName: \"kubernetes.io/projected/4a23f97c-6a64-4a39-97bf-3e6cc8af39f7-kube-api-access-m844b\") pod \"4a23f97c-6a64-4a39-97bf-3e6cc8af39f7\" (UID: \"4a23f97c-6a64-4a39-97bf-3e6cc8af39f7\") " Jul 07 15:39:02.041477 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.041452 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a23f97c-6a64-4a39-97bf-3e6cc8af39f7-kube-api-access-m844b" (OuterVolumeSpecName: "kube-api-access-m844b") pod "4a23f97c-6a64-4a39-97bf-3e6cc8af39f7" (UID: "4a23f97c-6a64-4a39-97bf-3e6cc8af39f7"). InnerVolumeSpecName "kube-api-access-m844b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:39:02.139916 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.139876 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m844b\" (UniqueName: \"kubernetes.io/projected/4a23f97c-6a64-4a39-97bf-3e6cc8af39f7-kube-api-access-m844b\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:39:02.724419 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.724381 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a23f97c-6a64-4a39-97bf-3e6cc8af39f7" containerID="a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd" exitCode=0 Jul 07 15:39:02.724885 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.724446 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x9k7j" Jul 07 15:39:02.724885 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.724465 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x9k7j" event={"ID":"4a23f97c-6a64-4a39-97bf-3e6cc8af39f7","Type":"ContainerDied","Data":"a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd"} Jul 07 15:39:02.724885 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.724509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x9k7j" event={"ID":"4a23f97c-6a64-4a39-97bf-3e6cc8af39f7","Type":"ContainerDied","Data":"64d7b87fe2d9c3758612f82e88ebc66878dac67b94be6bc4b0576a7bbb789bee"} Jul 07 15:39:02.724885 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.724527 2561 scope.go:117] "RemoveContainer" containerID="a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd" Jul 07 15:39:02.733452 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.733430 2561 scope.go:117] "RemoveContainer" containerID="a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd" Jul 07 15:39:02.733746 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:39:02.733726 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd\": container with ID starting with a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd not found: ID does not exist" containerID="a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd" Jul 07 15:39:02.733800 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.733756 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd"} err="failed to get container status \"a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd\": rpc error: code = NotFound desc = could not find container \"a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd\": container with ID starting with a8d0ba012e93a88fc25ff7c0b840c2ac35c60174b886a10a739e60e41c7882fd not found: ID does not exist" Jul 07 15:39:02.746548 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.746519 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-x9k7j"] Jul 07 15:39:02.750650 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:02.750623 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-x9k7j"] Jul 07 15:39:03.160087 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:03.160043 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a23f97c-6a64-4a39-97bf-3e6cc8af39f7" path="/var/lib/kubelet/pods/4a23f97c-6a64-4a39-97bf-3e6cc8af39f7/volumes" Jul 07 15:39:09.576176 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:09.576109 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rlh6s"] Jul 07 15:39:09.576669 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:09.576390 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" podUID="daed78bb-a715-4fd5-9dd1-545025bd0b23" containerName="limitador" containerID="cri-o://96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a" gracePeriod=30 Jul 07 15:39:09.577074 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:09.577055 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:39:10.131104 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.131079 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:39:10.210110 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.210020 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daed78bb-a715-4fd5-9dd1-545025bd0b23-config-file\") pod \"daed78bb-a715-4fd5-9dd1-545025bd0b23\" (UID: \"daed78bb-a715-4fd5-9dd1-545025bd0b23\") " Jul 07 15:39:10.210279 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.210147 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn2jm\" (UniqueName: \"kubernetes.io/projected/daed78bb-a715-4fd5-9dd1-545025bd0b23-kube-api-access-fn2jm\") pod \"daed78bb-a715-4fd5-9dd1-545025bd0b23\" (UID: \"daed78bb-a715-4fd5-9dd1-545025bd0b23\") " Jul 07 15:39:10.210407 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.210384 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daed78bb-a715-4fd5-9dd1-545025bd0b23-config-file" (OuterVolumeSpecName: "config-file") pod "daed78bb-a715-4fd5-9dd1-545025bd0b23" (UID: "daed78bb-a715-4fd5-9dd1-545025bd0b23"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:39:10.212327 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.212305 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daed78bb-a715-4fd5-9dd1-545025bd0b23-kube-api-access-fn2jm" (OuterVolumeSpecName: "kube-api-access-fn2jm") pod "daed78bb-a715-4fd5-9dd1-545025bd0b23" (UID: "daed78bb-a715-4fd5-9dd1-545025bd0b23"). InnerVolumeSpecName "kube-api-access-fn2jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:39:10.311112 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.311074 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daed78bb-a715-4fd5-9dd1-545025bd0b23-config-file\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:39:10.311112 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.311103 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn2jm\" (UniqueName: \"kubernetes.io/projected/daed78bb-a715-4fd5-9dd1-545025bd0b23-kube-api-access-fn2jm\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:39:10.767319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.767275 2561 generic.go:356] "Generic (PLEG): container finished" podID="daed78bb-a715-4fd5-9dd1-545025bd0b23" containerID="96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a" exitCode=0 Jul 07 15:39:10.767319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.767320 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" Jul 07 15:39:10.767765 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.767358 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" event={"ID":"daed78bb-a715-4fd5-9dd1-545025bd0b23","Type":"ContainerDied","Data":"96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a"} Jul 07 15:39:10.767765 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.767419 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rlh6s" event={"ID":"daed78bb-a715-4fd5-9dd1-545025bd0b23","Type":"ContainerDied","Data":"baee8599d31a0acde0f1e003156dfccd50e98a480a16af4d103d52ea4104a628"} Jul 07 15:39:10.767765 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.767442 2561 scope.go:117] "RemoveContainer" containerID="96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a" Jul 07 15:39:10.776376 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.776356 2561 scope.go:117] "RemoveContainer" containerID="96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a" Jul 07 15:39:10.776641 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:39:10.776620 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a\": container with ID starting with 96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a not found: ID does not exist" containerID="96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a" Jul 07 15:39:10.776707 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.776650 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a"} err="failed to get container status \"96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a\": rpc error: code = NotFound desc = could not find container \"96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a\": container with ID starting with 96b0c5e9cc3167309811d260fcfa00a2812ffc6aba385355a36a3df22583aa3a not found: ID does not exist" Jul 07 15:39:10.797573 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.797540 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rlh6s"] Jul 07 15:39:10.804481 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:10.804457 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rlh6s"] Jul 07 15:39:11.159977 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:11.159945 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daed78bb-a715-4fd5-9dd1-545025bd0b23" path="/var/lib/kubelet/pods/daed78bb-a715-4fd5-9dd1-545025bd0b23/volumes" Jul 07 15:39:14.749655 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.749621 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-ts5fm"] Jul 07 15:39:14.750255 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.749959 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daed78bb-a715-4fd5-9dd1-545025bd0b23" containerName="limitador" Jul 07 15:39:14.750255 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.749971 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="daed78bb-a715-4fd5-9dd1-545025bd0b23" containerName="limitador" Jul 07 15:39:14.750255 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.749989 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a23f97c-6a64-4a39-97bf-3e6cc8af39f7" containerName="authorino" Jul 07 15:39:14.750255 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.749995 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a23f97c-6a64-4a39-97bf-3e6cc8af39f7" containerName="authorino" Jul 07 15:39:14.750255 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.750047 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a23f97c-6a64-4a39-97bf-3e6cc8af39f7" containerName="authorino" Jul 07 15:39:14.750255 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.750057 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="daed78bb-a715-4fd5-9dd1-545025bd0b23" containerName="limitador" Jul 07 15:39:14.754495 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.754471 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:14.757112 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.757089 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w85xc\"" Jul 07 15:39:14.757112 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.757096 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 15:39:14.764268 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.764242 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ts5fm"] Jul 07 15:39:14.850501 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.850465 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d2w9\" (UniqueName: \"kubernetes.io/projected/2bf647db-6bb9-44ea-aa8d-fe6751dac406-kube-api-access-9d2w9\") pod \"postgres-69fb4594cf-ts5fm\" (UID: \"2bf647db-6bb9-44ea-aa8d-fe6751dac406\") " pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:14.850672 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.850513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2bf647db-6bb9-44ea-aa8d-fe6751dac406-data\") pod \"postgres-69fb4594cf-ts5fm\" (UID: \"2bf647db-6bb9-44ea-aa8d-fe6751dac406\") " pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:14.951805 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.951762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2bf647db-6bb9-44ea-aa8d-fe6751dac406-data\") pod \"postgres-69fb4594cf-ts5fm\" (UID: \"2bf647db-6bb9-44ea-aa8d-fe6751dac406\") " pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:14.951994 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.951858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d2w9\" (UniqueName: \"kubernetes.io/projected/2bf647db-6bb9-44ea-aa8d-fe6751dac406-kube-api-access-9d2w9\") pod \"postgres-69fb4594cf-ts5fm\" (UID: \"2bf647db-6bb9-44ea-aa8d-fe6751dac406\") " pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:14.952209 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.952191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2bf647db-6bb9-44ea-aa8d-fe6751dac406-data\") pod \"postgres-69fb4594cf-ts5fm\" (UID: \"2bf647db-6bb9-44ea-aa8d-fe6751dac406\") " pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:14.969285 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:14.969255 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d2w9\" (UniqueName: \"kubernetes.io/projected/2bf647db-6bb9-44ea-aa8d-fe6751dac406-kube-api-access-9d2w9\") pod \"postgres-69fb4594cf-ts5fm\" (UID: \"2bf647db-6bb9-44ea-aa8d-fe6751dac406\") " pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:15.065914 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:15.065815 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:15.204380 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:15.204353 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ts5fm"] Jul 07 15:39:15.207306 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:39:15.207277 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf647db_6bb9_44ea_aa8d_fe6751dac406.slice/crio-2673907168a45ef66fb663ebaeb2ab5b2c4a6b5438a4bc8d2d1947390da9f923 WatchSource:0}: Error finding container 2673907168a45ef66fb663ebaeb2ab5b2c4a6b5438a4bc8d2d1947390da9f923: Status 404 returned error can't find the container with id 2673907168a45ef66fb663ebaeb2ab5b2c4a6b5438a4bc8d2d1947390da9f923 Jul 07 15:39:15.796427 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:15.796384 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ts5fm" event={"ID":"2bf647db-6bb9-44ea-aa8d-fe6751dac406","Type":"ContainerStarted","Data":"2673907168a45ef66fb663ebaeb2ab5b2c4a6b5438a4bc8d2d1947390da9f923"} Jul 07 15:39:20.826449 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:20.826411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ts5fm" event={"ID":"2bf647db-6bb9-44ea-aa8d-fe6751dac406","Type":"ContainerStarted","Data":"9fc9e150d92731fadaad8e7173337d09cf52280b50e1f37817e0364e0c47ec89"} Jul 07 15:39:20.826837 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:20.826531 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:20.849394 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:20.849345 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-ts5fm" podStartSLOduration=2.129490271 podStartE2EDuration="6.849330388s" totalImagesPullingTime="4.719840117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:20.847012035 +0000 UTC m=+594.269731271" watchObservedRunningTime="2026-07-07 15:39:20.849330388 +0000 UTC m=+594.272049623" Jul 07 15:39:26.861976 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:26.861945 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-ts5fm" Jul 07 15:39:27.037742 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:27.037702 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:39:27.045648 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:27.045616 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:39:33.665437 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.665398 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-689f76b9d7-cp4j7"] Jul 07 15:39:33.772369 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.772325 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-689f76b9d7-cp4j7"] Jul 07 15:39:33.772533 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.772451 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:33.775474 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.775453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 15:39:33.775596 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.775478 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 15:39:33.776567 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.776549 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q6lbm\"" Jul 07 15:39:33.806899 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.806866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae5f5df7-64df-4380-81cd-1758c99de115-webhook-cert\") pod \"maas-controller-689f76b9d7-cp4j7\" (UID: \"ae5f5df7-64df-4380-81cd-1758c99de115\") " pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:33.807078 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.806926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxvhx\" (UniqueName: \"kubernetes.io/projected/ae5f5df7-64df-4380-81cd-1758c99de115-kube-api-access-wxvhx\") pod \"maas-controller-689f76b9d7-cp4j7\" (UID: \"ae5f5df7-64df-4380-81cd-1758c99de115\") " pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:33.908052 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.908020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae5f5df7-64df-4380-81cd-1758c99de115-webhook-cert\") pod \"maas-controller-689f76b9d7-cp4j7\" (UID: \"ae5f5df7-64df-4380-81cd-1758c99de115\") " pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:33.908268 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.908097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxvhx\" (UniqueName: \"kubernetes.io/projected/ae5f5df7-64df-4380-81cd-1758c99de115-kube-api-access-wxvhx\") pod \"maas-controller-689f76b9d7-cp4j7\" (UID: \"ae5f5df7-64df-4380-81cd-1758c99de115\") " pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:33.908268 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:39:33.908191 2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 15:39:33.908363 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:39:33.908276 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5f5df7-64df-4380-81cd-1758c99de115-webhook-cert podName:ae5f5df7-64df-4380-81cd-1758c99de115 nodeName:}" failed. No retries permitted until 2026-07-07 15:39:34.40825102 +0000 UTC m=+607.830970236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ae5f5df7-64df-4380-81cd-1758c99de115-webhook-cert") pod "maas-controller-689f76b9d7-cp4j7" (UID: "ae5f5df7-64df-4380-81cd-1758c99de115") : secret "maas-controller-webhook-cert" not found Jul 07 15:39:33.918451 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:33.918389 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxvhx\" (UniqueName: \"kubernetes.io/projected/ae5f5df7-64df-4380-81cd-1758c99de115-kube-api-access-wxvhx\") pod \"maas-controller-689f76b9d7-cp4j7\" (UID: \"ae5f5df7-64df-4380-81cd-1758c99de115\") " pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:34.411754 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:34.411720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae5f5df7-64df-4380-81cd-1758c99de115-webhook-cert\") pod \"maas-controller-689f76b9d7-cp4j7\" (UID: \"ae5f5df7-64df-4380-81cd-1758c99de115\") " pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:34.414429 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:34.414397 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae5f5df7-64df-4380-81cd-1758c99de115-webhook-cert\") pod \"maas-controller-689f76b9d7-cp4j7\" (UID: \"ae5f5df7-64df-4380-81cd-1758c99de115\") " pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:34.682752 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:34.682666 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:34.892969 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:34.892938 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-689f76b9d7-cp4j7"] Jul 07 15:39:34.894521 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:39:34.894480 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5f5df7_64df_4380_81cd_1758c99de115.slice/crio-cda86ba91d5a13934ac01f92a1f3288975ed96bf57417aaa74328d0876c854fe WatchSource:0}: Error finding container cda86ba91d5a13934ac01f92a1f3288975ed96bf57417aaa74328d0876c854fe: Status 404 returned error can't find the container with id cda86ba91d5a13934ac01f92a1f3288975ed96bf57417aaa74328d0876c854fe Jul 07 15:39:35.907956 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:35.907917 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" event={"ID":"ae5f5df7-64df-4380-81cd-1758c99de115","Type":"ContainerStarted","Data":"cda86ba91d5a13934ac01f92a1f3288975ed96bf57417aaa74328d0876c854fe"} Jul 07 15:39:37.919222 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:37.919178 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" event={"ID":"ae5f5df7-64df-4380-81cd-1758c99de115","Type":"ContainerStarted","Data":"4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a"} Jul 07 15:39:37.919614 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:37.919335 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:37.951189 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:37.951129 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" podStartSLOduration=2.95491215 podStartE2EDuration="4.951100696s" totalImagesPullingTime="1.996188546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:37.949693316 +0000 UTC m=+611.372412549" watchObservedRunningTime="2026-07-07 15:39:37.951100696 +0000 UTC m=+611.373819934" Jul 07 15:39:48.930185 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:48.930074 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:49.029646 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.029606 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-689f76b9d7-cp4j7"] Jul 07 15:39:49.029897 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.029851 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" podUID="ae5f5df7-64df-4380-81cd-1758c99de115" containerName="manager" containerID="cri-o://4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a" gracePeriod=30 Jul 07 15:39:49.284392 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.284365 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:49.339592 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.339558 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae5f5df7-64df-4380-81cd-1758c99de115-webhook-cert\") pod \"ae5f5df7-64df-4380-81cd-1758c99de115\" (UID: \"ae5f5df7-64df-4380-81cd-1758c99de115\") " Jul 07 15:39:49.339765 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.339625 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxvhx\" (UniqueName: \"kubernetes.io/projected/ae5f5df7-64df-4380-81cd-1758c99de115-kube-api-access-wxvhx\") pod \"ae5f5df7-64df-4380-81cd-1758c99de115\" (UID: \"ae5f5df7-64df-4380-81cd-1758c99de115\") " Jul 07 15:39:49.341966 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.341928 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5f5df7-64df-4380-81cd-1758c99de115-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ae5f5df7-64df-4380-81cd-1758c99de115" (UID: "ae5f5df7-64df-4380-81cd-1758c99de115"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:39:49.341966 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.341949 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5f5df7-64df-4380-81cd-1758c99de115-kube-api-access-wxvhx" (OuterVolumeSpecName: "kube-api-access-wxvhx") pod "ae5f5df7-64df-4380-81cd-1758c99de115" (UID: "ae5f5df7-64df-4380-81cd-1758c99de115"). InnerVolumeSpecName "kube-api-access-wxvhx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:39:49.441250 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.441213 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxvhx\" (UniqueName: \"kubernetes.io/projected/ae5f5df7-64df-4380-81cd-1758c99de115-kube-api-access-wxvhx\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:39:49.441250 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.441246 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae5f5df7-64df-4380-81cd-1758c99de115-webhook-cert\") on node \"ip-10-0-130-86.ec2.internal\" DevicePath \"\"" Jul 07 15:39:49.978681 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.978648 2561 generic.go:356] "Generic (PLEG): container finished" podID="ae5f5df7-64df-4380-81cd-1758c99de115" containerID="4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a" exitCode=0 Jul 07 15:39:49.979154 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.978697 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" Jul 07 15:39:49.979154 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.978732 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" event={"ID":"ae5f5df7-64df-4380-81cd-1758c99de115","Type":"ContainerDied","Data":"4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a"} Jul 07 15:39:49.979154 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.978792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689f76b9d7-cp4j7" event={"ID":"ae5f5df7-64df-4380-81cd-1758c99de115","Type":"ContainerDied","Data":"cda86ba91d5a13934ac01f92a1f3288975ed96bf57417aaa74328d0876c854fe"} Jul 07 15:39:49.979154 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.978815 2561 scope.go:117] "RemoveContainer" containerID="4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a" Jul 07 15:39:49.987883 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.987865 2561 scope.go:117] "RemoveContainer" containerID="4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a" Jul 07 15:39:49.988169 ip-10-0-130-86 kubenswrapper[2561]: E0707 15:39:49.988150 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a\": container with ID starting with 4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a not found: ID does not exist" containerID="4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a" Jul 07 15:39:49.988236 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:49.988177 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a"} err="failed to get container status \"4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a\": rpc error: code = NotFound desc = could not find container \"4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a\": container with ID starting with 4ddbd3eedae71774a389920d84ee28347a1f1993d1f27f43865574d62e22fd7a not found: ID does not exist" Jul 07 15:39:50.002901 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:50.002874 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-689f76b9d7-cp4j7"] Jul 07 15:39:50.007837 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:50.007814 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-689f76b9d7-cp4j7"] Jul 07 15:39:51.160736 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:39:51.160705 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae5f5df7-64df-4380-81cd-1758c99de115" path="/var/lib/kubelet/pods/ae5f5df7-64df-4380-81cd-1758c99de115/volumes" Jul 07 15:40:09.394429 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.394397 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-54b8744cc8-9pgr6"] Jul 07 15:40:09.394817 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.394741 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5f5df7-64df-4380-81cd-1758c99de115" containerName="manager" Jul 07 15:40:09.394817 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.394753 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5f5df7-64df-4380-81cd-1758c99de115" containerName="manager" Jul 07 15:40:09.394892 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.394818 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5f5df7-64df-4380-81cd-1758c99de115" containerName="manager" Jul 07 15:40:09.397630 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.397614 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.401351 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.401323 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 07 15:40:09.401470 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.401351 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hvgw6\"" Jul 07 15:40:09.417033 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.417005 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-54b8744cc8-9pgr6"] Jul 07 15:40:09.516854 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.516818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3b7a179-d2e6-45bb-9758-51c6c66cb456-maas-api-tls\") pod \"maas-api-54b8744cc8-9pgr6\" (UID: \"b3b7a179-d2e6-45bb-9758-51c6c66cb456\") " pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.517033 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.516879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s94jv\" (UniqueName: \"kubernetes.io/projected/b3b7a179-d2e6-45bb-9758-51c6c66cb456-kube-api-access-s94jv\") pod \"maas-api-54b8744cc8-9pgr6\" (UID: \"b3b7a179-d2e6-45bb-9758-51c6c66cb456\") " pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.517033 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.516926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b7a179-d2e6-45bb-9758-51c6c66cb456-openshift-service-ca\") pod \"maas-api-54b8744cc8-9pgr6\" (UID: \"b3b7a179-d2e6-45bb-9758-51c6c66cb456\") " pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.618207 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.618170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3b7a179-d2e6-45bb-9758-51c6c66cb456-maas-api-tls\") pod \"maas-api-54b8744cc8-9pgr6\" (UID: \"b3b7a179-d2e6-45bb-9758-51c6c66cb456\") " pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.618414 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.618224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s94jv\" (UniqueName: \"kubernetes.io/projected/b3b7a179-d2e6-45bb-9758-51c6c66cb456-kube-api-access-s94jv\") pod \"maas-api-54b8744cc8-9pgr6\" (UID: \"b3b7a179-d2e6-45bb-9758-51c6c66cb456\") " pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.618414 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.618247 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b7a179-d2e6-45bb-9758-51c6c66cb456-openshift-service-ca\") pod \"maas-api-54b8744cc8-9pgr6\" (UID: \"b3b7a179-d2e6-45bb-9758-51c6c66cb456\") " pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.618811 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.618794 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b7a179-d2e6-45bb-9758-51c6c66cb456-openshift-service-ca\") pod \"maas-api-54b8744cc8-9pgr6\" (UID: \"b3b7a179-d2e6-45bb-9758-51c6c66cb456\") " pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.620750 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.620730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3b7a179-d2e6-45bb-9758-51c6c66cb456-maas-api-tls\") pod \"maas-api-54b8744cc8-9pgr6\" (UID: \"b3b7a179-d2e6-45bb-9758-51c6c66cb456\") " pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.629086 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.629061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s94jv\" (UniqueName: \"kubernetes.io/projected/b3b7a179-d2e6-45bb-9758-51c6c66cb456-kube-api-access-s94jv\") pod \"maas-api-54b8744cc8-9pgr6\" (UID: \"b3b7a179-d2e6-45bb-9758-51c6c66cb456\") " pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.707372 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.707287 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:09.848558 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.848533 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-54b8744cc8-9pgr6"] Jul 07 15:40:09.850479 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:40:09.850451 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b7a179_d2e6_45bb_9758_51c6c66cb456.slice/crio-6de8fffb5299c976c0b4f609896c74e4ff152a28ec53d736d80c141ceca1b3ce WatchSource:0}: Error finding container 6de8fffb5299c976c0b4f609896c74e4ff152a28ec53d736d80c141ceca1b3ce: Status 404 returned error can't find the container with id 6de8fffb5299c976c0b4f609896c74e4ff152a28ec53d736d80c141ceca1b3ce Jul 07 15:40:09.851885 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.851866 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:40:09.917699 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.917667 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-c4xg5"] Jul 07 15:40:09.920624 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.920608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:09.924675 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.924646 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 15:40:09.924914 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.924893 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5qrpt\"" Jul 07 15:40:09.934170 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:09.934141 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-c4xg5"] Jul 07 15:40:10.022804 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:10.022718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rs2q\" (UniqueName: \"kubernetes.io/projected/9bcff40e-139f-46eb-ae0e-9f2ada711949-kube-api-access-4rs2q\") pod \"payload-processing-58f86c7798-c4xg5\" (UID: \"9bcff40e-139f-46eb-ae0e-9f2ada711949\") " pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:10.022804 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:10.022770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bcff40e-139f-46eb-ae0e-9f2ada711949-plugins-config-volume\") pod \"payload-processing-58f86c7798-c4xg5\" (UID: \"9bcff40e-139f-46eb-ae0e-9f2ada711949\") " pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:10.080754 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:10.080722 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-54b8744cc8-9pgr6" event={"ID":"b3b7a179-d2e6-45bb-9758-51c6c66cb456","Type":"ContainerStarted","Data":"6de8fffb5299c976c0b4f609896c74e4ff152a28ec53d736d80c141ceca1b3ce"} Jul 07 15:40:10.124290 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:10.124244 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bcff40e-139f-46eb-ae0e-9f2ada711949-plugins-config-volume\") pod \"payload-processing-58f86c7798-c4xg5\" (UID: \"9bcff40e-139f-46eb-ae0e-9f2ada711949\") " pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:10.124485 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:10.124336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rs2q\" (UniqueName: \"kubernetes.io/projected/9bcff40e-139f-46eb-ae0e-9f2ada711949-kube-api-access-4rs2q\") pod \"payload-processing-58f86c7798-c4xg5\" (UID: \"9bcff40e-139f-46eb-ae0e-9f2ada711949\") " pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:10.124947 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:10.124924 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bcff40e-139f-46eb-ae0e-9f2ada711949-plugins-config-volume\") pod \"payload-processing-58f86c7798-c4xg5\" (UID: \"9bcff40e-139f-46eb-ae0e-9f2ada711949\") " pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:10.134280 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:10.134254 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rs2q\" (UniqueName: \"kubernetes.io/projected/9bcff40e-139f-46eb-ae0e-9f2ada711949-kube-api-access-4rs2q\") pod \"payload-processing-58f86c7798-c4xg5\" (UID: \"9bcff40e-139f-46eb-ae0e-9f2ada711949\") " pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:10.233241 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:10.233191 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:10.369269 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:10.369245 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-c4xg5"] Jul 07 15:40:10.369759 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:40:10.369734 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcff40e_139f_46eb_ae0e_9f2ada711949.slice/crio-15ed389d0c8682935388a74a9cf9148ddc4c79ba9804d1e37e7a18fef0aa82c0 WatchSource:0}: Error finding container 15ed389d0c8682935388a74a9cf9148ddc4c79ba9804d1e37e7a18fef0aa82c0: Status 404 returned error can't find the container with id 15ed389d0c8682935388a74a9cf9148ddc4c79ba9804d1e37e7a18fef0aa82c0 Jul 07 15:40:11.089961 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:11.089924 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" event={"ID":"9bcff40e-139f-46eb-ae0e-9f2ada711949","Type":"ContainerStarted","Data":"15ed389d0c8682935388a74a9cf9148ddc4c79ba9804d1e37e7a18fef0aa82c0"} Jul 07 15:40:12.103529 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:12.103488 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-54b8744cc8-9pgr6" event={"ID":"b3b7a179-d2e6-45bb-9758-51c6c66cb456","Type":"ContainerStarted","Data":"08e17d02951065083ff3a2e8903f5c91c6e4900414cd43a27f66483d1ee175d4"} Jul 07 15:40:12.104010 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:12.103585 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:12.105371 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:12.105339 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" event={"ID":"9bcff40e-139f-46eb-ae0e-9f2ada711949","Type":"ContainerStarted","Data":"06533540c590a55675ccf27da2b7dbf13c2e7f7512d72ec34ed088af363ecb6c"} Jul 07 15:40:12.105492 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:12.105398 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:12.137696 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:12.137643 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-54b8744cc8-9pgr6" podStartSLOduration=1.010006846 podStartE2EDuration="3.137628541s" totalImagesPullingTime="2.127621695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:40:12.137056121 +0000 UTC m=+645.559775355" watchObservedRunningTime="2026-07-07 15:40:12.137628541 +0000 UTC m=+645.560347775" Jul 07 15:40:12.171350 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:12.171296 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" podStartSLOduration=1.561347442 podStartE2EDuration="3.171277459s" totalImagesPullingTime="1.609930017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:40:12.169241362 +0000 UTC m=+645.591960595" watchObservedRunningTime="2026-07-07 15:40:12.171277459 +0000 UTC m=+645.593996692" Jul 07 15:40:18.117394 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:18.117366 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-54b8744cc8-9pgr6" Jul 07 15:40:23.114021 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:23.113990 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-c4xg5" Jul 07 15:40:40.006286 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.006255 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h"] Jul 07 15:40:40.010646 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.010630 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.013447 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.013425 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 15:40:40.014645 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.014626 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6dn84\"" Jul 07 15:40:40.014732 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.014629 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 15:40:40.014732 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.014673 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 15:40:40.020339 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.020296 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h"] Jul 07 15:40:40.088179 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.088145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.088179 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.088183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.088399 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.088214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.088399 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.088253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.088399 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.088271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3405ad10-b20c-4e12-baca-29aa7cd61a93-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.088399 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.088337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngmf\" (UniqueName: \"kubernetes.io/projected/3405ad10-b20c-4e12-baca-29aa7cd61a93-kube-api-access-lngmf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.189719 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.189683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngmf\" (UniqueName: \"kubernetes.io/projected/3405ad10-b20c-4e12-baca-29aa7cd61a93-kube-api-access-lngmf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.189878 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.189793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.189878 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.189827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.189878 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.189860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.190042 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.189979 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.190042 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.190014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3405ad10-b20c-4e12-baca-29aa7cd61a93-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.190307 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.190273 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.190427 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.190346 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.190427 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.190386 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.192419 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.192394 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3405ad10-b20c-4e12-baca-29aa7cd61a93-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.192565 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.192547 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3405ad10-b20c-4e12-baca-29aa7cd61a93-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.200206 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.200187 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngmf\" (UniqueName: \"kubernetes.io/projected/3405ad10-b20c-4e12-baca-29aa7cd61a93-kube-api-access-lngmf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r5j5h\" (UID: \"3405ad10-b20c-4e12-baca-29aa7cd61a93\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.320921 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.320823 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:40.464632 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:40.464609 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h"] Jul 07 15:40:40.465585 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:40:40.465555 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3405ad10_b20c_4e12_baca_29aa7cd61a93.slice/crio-277e4855c8d7f755ee0d24bb98e041c7131079d55192e69a79bbb1d605b40400 WatchSource:0}: Error finding container 277e4855c8d7f755ee0d24bb98e041c7131079d55192e69a79bbb1d605b40400: Status 404 returned error can't find the container with id 277e4855c8d7f755ee0d24bb98e041c7131079d55192e69a79bbb1d605b40400 Jul 07 15:40:41.254106 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:41.254066 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" event={"ID":"3405ad10-b20c-4e12-baca-29aa7cd61a93","Type":"ContainerStarted","Data":"277e4855c8d7f755ee0d24bb98e041c7131079d55192e69a79bbb1d605b40400"} Jul 07 15:40:42.260759 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:42.260725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" event={"ID":"3405ad10-b20c-4e12-baca-29aa7cd61a93","Type":"ContainerStarted","Data":"3c4519cc309cf37d55573627e3116f8dd7dc1ef0994b4763e2d52a2b20227c8c"} Jul 07 15:40:42.291050 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:42.290979 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" podStartSLOduration=2.264417808 podStartE2EDuration="3.290956225s" totalImagesPullingTime="1.026538417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:40:42.286218561 +0000 UTC m=+675.708937795" watchObservedRunningTime="2026-07-07 15:40:42.290956225 +0000 UTC m=+675.713675462" Jul 07 15:40:50.321936 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:50.321889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:50.322456 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:50.321977 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:50.334563 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:50.334537 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:40:51.317221 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:40:51.317192 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r5j5h" Jul 07 15:41:06.233279 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.233247 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst"] Jul 07 15:41:06.235777 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.235761 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.239469 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.239446 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 07 15:41:06.251709 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.251679 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst"] Jul 07 15:41:06.326947 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.326912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.327189 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.326958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.327189 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.326985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.327189 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.327079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.327189 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.327162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99a91a0e-1d51-4941-bd2c-d93158f50ea7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.327360 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.327204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs8xp\" (UniqueName: \"kubernetes.io/projected/99a91a0e-1d51-4941-bd2c-d93158f50ea7-kube-api-access-xs8xp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.427861 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.427762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.427861 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.427838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.428094 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.427875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99a91a0e-1d51-4941-bd2c-d93158f50ea7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.428094 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.428012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs8xp\" (UniqueName: \"kubernetes.io/projected/99a91a0e-1d51-4941-bd2c-d93158f50ea7-kube-api-access-xs8xp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.428264 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.428097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.428264 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.428171 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.428264 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.428222 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.428394 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.428271 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.428452 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.428433 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.430312 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.430287 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99a91a0e-1d51-4941-bd2c-d93158f50ea7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.430566 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.430550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99a91a0e-1d51-4941-bd2c-d93158f50ea7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.439597 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.439577 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs8xp\" (UniqueName: \"kubernetes.io/projected/99a91a0e-1d51-4941-bd2c-d93158f50ea7-kube-api-access-xs8xp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst\" (UID: \"99a91a0e-1d51-4941-bd2c-d93158f50ea7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.544304 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.544271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:06.693716 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:06.693692 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst"] Jul 07 15:41:06.695591 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:41:06.695565 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99a91a0e_1d51_4941_bd2c_d93158f50ea7.slice/crio-45c0f81977bb025beb6154a3ece52daf7be72889fb8268d0c5709c872a96b100 WatchSource:0}: Error finding container 45c0f81977bb025beb6154a3ece52daf7be72889fb8268d0c5709c872a96b100: Status 404 returned error can't find the container with id 45c0f81977bb025beb6154a3ece52daf7be72889fb8268d0c5709c872a96b100 Jul 07 15:41:07.394104 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:07.394063 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" event={"ID":"99a91a0e-1d51-4941-bd2c-d93158f50ea7","Type":"ContainerStarted","Data":"80367cea1d4a503dda91c08b86911c4b99f06ff6751d867bb680d0b6568b4979"} Jul 07 15:41:07.394104 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:07.394108 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" event={"ID":"99a91a0e-1d51-4941-bd2c-d93158f50ea7","Type":"ContainerStarted","Data":"45c0f81977bb025beb6154a3ece52daf7be72889fb8268d0c5709c872a96b100"} Jul 07 15:41:07.419059 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:07.419005 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" podStartSLOduration=1.22042311 podStartE2EDuration="1.418990832s" totalImagesPullingTime="198.567722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:07.415315867 +0000 UTC m=+700.838035102" watchObservedRunningTime="2026-07-07 15:41:07.418990832 +0000 UTC m=+700.841710066" Jul 07 15:41:16.545240 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:16.545200 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:16.545676 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:16.545260 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:16.557797 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:16.557770 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:17.457643 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:17.457617 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst" Jul 07 15:41:52.665502 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.665464 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66f4798cbc-zdh5k"] Jul 07 15:41:52.668822 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.668804 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f4798cbc-zdh5k" Jul 07 15:41:52.674017 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.673994 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 15:41:52.674168 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.674034 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ntfdw\"" Jul 07 15:41:52.682851 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.682826 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66f4798cbc-zdh5k"] Jul 07 15:41:52.833055 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.833020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dad3bd8a-8779-4f72-b95d-026ddf8d819f-tls-cert\") pod \"authorino-66f4798cbc-zdh5k\" (UID: \"dad3bd8a-8779-4f72-b95d-026ddf8d819f\") " pod="kuadrant-system/authorino-66f4798cbc-zdh5k" Jul 07 15:41:52.833055 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.833055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfdsc\" (UniqueName: \"kubernetes.io/projected/dad3bd8a-8779-4f72-b95d-026ddf8d819f-kube-api-access-pfdsc\") pod \"authorino-66f4798cbc-zdh5k\" (UID: \"dad3bd8a-8779-4f72-b95d-026ddf8d819f\") " pod="kuadrant-system/authorino-66f4798cbc-zdh5k" Jul 07 15:41:52.934588 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.934500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dad3bd8a-8779-4f72-b95d-026ddf8d819f-tls-cert\") pod \"authorino-66f4798cbc-zdh5k\" (UID: \"dad3bd8a-8779-4f72-b95d-026ddf8d819f\") " pod="kuadrant-system/authorino-66f4798cbc-zdh5k" Jul 07 15:41:52.934588 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.934540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfdsc\" (UniqueName: \"kubernetes.io/projected/dad3bd8a-8779-4f72-b95d-026ddf8d819f-kube-api-access-pfdsc\") pod \"authorino-66f4798cbc-zdh5k\" (UID: \"dad3bd8a-8779-4f72-b95d-026ddf8d819f\") " pod="kuadrant-system/authorino-66f4798cbc-zdh5k" Jul 07 15:41:52.937092 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.937072 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dad3bd8a-8779-4f72-b95d-026ddf8d819f-tls-cert\") pod \"authorino-66f4798cbc-zdh5k\" (UID: \"dad3bd8a-8779-4f72-b95d-026ddf8d819f\") " pod="kuadrant-system/authorino-66f4798cbc-zdh5k" Jul 07 15:41:52.944687 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.944650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfdsc\" (UniqueName: \"kubernetes.io/projected/dad3bd8a-8779-4f72-b95d-026ddf8d819f-kube-api-access-pfdsc\") pod \"authorino-66f4798cbc-zdh5k\" (UID: \"dad3bd8a-8779-4f72-b95d-026ddf8d819f\") " pod="kuadrant-system/authorino-66f4798cbc-zdh5k" Jul 07 15:41:52.978294 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:52.978264 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f4798cbc-zdh5k" Jul 07 15:41:53.183688 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:53.183660 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66f4798cbc-zdh5k"] Jul 07 15:41:53.184662 ip-10-0-130-86 kubenswrapper[2561]: W0707 15:41:53.184612 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddad3bd8a_8779_4f72_b95d_026ddf8d819f.slice/crio-ffd5639ad133aee15f8bc2188e966e64897c18df63703bcdc02cfd592ac3243f WatchSource:0}: Error finding container ffd5639ad133aee15f8bc2188e966e64897c18df63703bcdc02cfd592ac3243f: Status 404 returned error can't find the container with id ffd5639ad133aee15f8bc2188e966e64897c18df63703bcdc02cfd592ac3243f Jul 07 15:41:53.626368 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:53.626335 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f4798cbc-zdh5k" event={"ID":"dad3bd8a-8779-4f72-b95d-026ddf8d819f","Type":"ContainerStarted","Data":"ffd5639ad133aee15f8bc2188e966e64897c18df63703bcdc02cfd592ac3243f"} Jul 07 15:41:54.633319 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:54.633281 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f4798cbc-zdh5k" event={"ID":"dad3bd8a-8779-4f72-b95d-026ddf8d819f","Type":"ContainerStarted","Data":"93dbcd01d7dba919e0d95e4c1f92eba4526c2ca9c92054bc57cecb3f729d6254"} Jul 07 15:41:54.657834 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:41:54.657763 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66f4798cbc-zdh5k" podStartSLOduration=2.073269478 podStartE2EDuration="2.657739858s" totalImagesPullingTime="584.47038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:41:54.655428588 +0000 UTC m=+748.078147823" watchObservedRunningTime="2026-07-07 15:41:54.657739858 +0000 UTC m=+748.080459094" Jul 07 15:44:27.080243 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:44:27.080164 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:44:27.085231 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:44:27.085207 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:49:27.118160 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:49:27.118114 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:49:27.119332 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:49:27.119309 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:54:27.165929 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:54:27.165895 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:54:27.168073 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:54:27.168051 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:59:27.201206 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:59:27.201174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 15:59:27.205489 ip-10-0-130-86 kubenswrapper[2561]: I0707 15:59:27.205461 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 16:04:27.234616 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:04:27.234584 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 16:04:27.240724 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:04:27.240700 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 16:09:27.270804 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:09:27.270775 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 16:09:27.279574 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:09:27.279554 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 16:11:31.783943 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:31.783864 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66f4798cbc-zdh5k_dad3bd8a-8779-4f72-b95d-026ddf8d819f/authorino/0.log" Jul 07 16:11:37.075440 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:37.075408 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-54b8744cc8-9pgr6_b3b7a179-d2e6-45bb-9758-51c6c66cb456/maas-api/0.log" Jul 07 16:11:37.704324 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:37.704293 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nfxv4_d84189d7-9972-420e-84cf-42fd69638c86/manager/0.log" Jul 07 16:11:37.836622 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:37.836594 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-95jlw_00c88abe-6c87-4d97-aa5c-70f0d9fb6181/copy-manifests/0.log" Jul 07 16:11:37.846953 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:37.846928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-95jlw_00c88abe-6c87-4d97-aa5c-70f0d9fb6181/manager/0.log" Jul 07 16:11:38.284354 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:38.284327 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ts5fm_2bf647db-6bb9-44ea-aa8d-fe6751dac406/postgres/0.log" Jul 07 16:11:39.135075 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.135044 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt_a4e6ab1c-2451-4f47-9059-3302b94f0d45/util/0.log" Jul 07 16:11:39.145988 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.145964 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt_a4e6ab1c-2451-4f47-9059-3302b94f0d45/pull/0.log" Jul 07 16:11:39.155855 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.155834 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt_a4e6ab1c-2451-4f47-9059-3302b94f0d45/extract/0.log" Jul 07 16:11:39.279206 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.279182 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh_04bee174-3c80-44a6-ba2c-c20f603eb5b3/util/0.log" Jul 07 16:11:39.290307 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.290286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh_04bee174-3c80-44a6-ba2c-c20f603eb5b3/pull/0.log" Jul 07 16:11:39.302552 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.302535 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh_04bee174-3c80-44a6-ba2c-c20f603eb5b3/extract/0.log" Jul 07 16:11:39.431140 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.431054 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn_bdce1042-8a7a-481f-8a96-5479fff35f27/extract/0.log" Jul 07 16:11:39.444555 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.444532 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn_bdce1042-8a7a-481f-8a96-5479fff35f27/util/0.log" Jul 07 16:11:39.456818 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.456796 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn_bdce1042-8a7a-481f-8a96-5479fff35f27/pull/0.log" Jul 07 16:11:39.578866 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.578844 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k_68deb6dc-a916-4fcb-b9e4-8500af143ce6/util/0.log" Jul 07 16:11:39.590887 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.590854 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k_68deb6dc-a916-4fcb-b9e4-8500af143ce6/pull/0.log" Jul 07 16:11:39.602956 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.602932 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k_68deb6dc-a916-4fcb-b9e4-8500af143ce6/extract/0.log" Jul 07 16:11:39.730523 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:39.730445 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66f4798cbc-zdh5k_dad3bd8a-8779-4f72-b95d-026ddf8d819f/authorino/0.log" Jul 07 16:11:40.114739 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:40.114713 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vvpsk_bfdfa166-28a2-4e48-b61c-08791a0e15b0/kuadrant-console-plugin/0.log" Jul 07 16:11:41.349980 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:41.349956 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd979f9c8-tb47h_b0ae57d4-b952-4853-ad0b-f151f4c12b3d/kube-auth-proxy/0.log" Jul 07 16:11:41.755502 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:41.755428 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-c4xg5_9bcff40e-139f-46eb-ae0e-9f2ada711949/payload-processing/0.log" Jul 07 16:11:42.371424 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:42.371390 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-r5j5h_3405ad10-b20c-4e12-baca-29aa7cd61a93/main/0.log" Jul 07 16:11:42.902130 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:42.902084 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-nlpst_99a91a0e-1d51-4941-bd2c-d93158f50ea7/main/0.log" Jul 07 16:11:47.829953 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.829917 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pxzwv/must-gather-6c7r9"] Jul 07 16:11:47.833533 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.833513 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxzwv/must-gather-6c7r9" Jul 07 16:11:47.836316 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.836291 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxzwv\"/\"kube-root-ca.crt\"" Jul 07 16:11:47.836438 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.836373 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxzwv\"/\"openshift-service-ca.crt\"" Jul 07 16:11:47.836515 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.836502 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pxzwv\"/\"default-dockercfg-2rm5d\"" Jul 07 16:11:47.846931 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.846911 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxzwv/must-gather-6c7r9"] Jul 07 16:11:47.860800 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.860777 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cmf6\" (UniqueName: \"kubernetes.io/projected/d4938739-8be7-47e6-a59e-4db6f550c175-kube-api-access-6cmf6\") pod \"must-gather-6c7r9\" (UID: \"d4938739-8be7-47e6-a59e-4db6f550c175\") " pod="openshift-must-gather-pxzwv/must-gather-6c7r9" Jul 07 16:11:47.860927 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.860827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4938739-8be7-47e6-a59e-4db6f550c175-must-gather-output\") pod \"must-gather-6c7r9\" (UID: \"d4938739-8be7-47e6-a59e-4db6f550c175\") " pod="openshift-must-gather-pxzwv/must-gather-6c7r9" Jul 07 16:11:47.961899 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.961866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cmf6\" (UniqueName: \"kubernetes.io/projected/d4938739-8be7-47e6-a59e-4db6f550c175-kube-api-access-6cmf6\") pod \"must-gather-6c7r9\" (UID: \"d4938739-8be7-47e6-a59e-4db6f550c175\") " pod="openshift-must-gather-pxzwv/must-gather-6c7r9" Jul 07 16:11:47.962072 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.961908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4938739-8be7-47e6-a59e-4db6f550c175-must-gather-output\") pod \"must-gather-6c7r9\" (UID: \"d4938739-8be7-47e6-a59e-4db6f550c175\") " pod="openshift-must-gather-pxzwv/must-gather-6c7r9" Jul 07 16:11:47.962253 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.962237 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4938739-8be7-47e6-a59e-4db6f550c175-must-gather-output\") pod \"must-gather-6c7r9\" (UID: \"d4938739-8be7-47e6-a59e-4db6f550c175\") " pod="openshift-must-gather-pxzwv/must-gather-6c7r9" Jul 07 16:11:47.972973 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:47.972943 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cmf6\" (UniqueName: \"kubernetes.io/projected/d4938739-8be7-47e6-a59e-4db6f550c175-kube-api-access-6cmf6\") pod \"must-gather-6c7r9\" (UID: \"d4938739-8be7-47e6-a59e-4db6f550c175\") " pod="openshift-must-gather-pxzwv/must-gather-6c7r9" Jul 07 16:11:48.143484 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:48.143444 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxzwv/must-gather-6c7r9" Jul 07 16:11:48.278452 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:48.278428 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxzwv/must-gather-6c7r9"] Jul 07 16:11:48.280487 ip-10-0-130-86 kubenswrapper[2561]: W0707 16:11:48.280454 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4938739_8be7_47e6_a59e_4db6f550c175.slice/crio-31d8d50489ccb988e803f5a36c8d2a1b45473f1bd750e4dade18de135aed5c48 WatchSource:0}: Error finding container 31d8d50489ccb988e803f5a36c8d2a1b45473f1bd750e4dade18de135aed5c48: Status 404 returned error can't find the container with id 31d8d50489ccb988e803f5a36c8d2a1b45473f1bd750e4dade18de135aed5c48 Jul 07 16:11:48.282707 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:48.282692 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:11:48.963619 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:48.963576 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxzwv/must-gather-6c7r9" event={"ID":"d4938739-8be7-47e6-a59e-4db6f550c175","Type":"ContainerStarted","Data":"31d8d50489ccb988e803f5a36c8d2a1b45473f1bd750e4dade18de135aed5c48"} Jul 07 16:11:49.973369 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:49.973325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxzwv/must-gather-6c7r9" event={"ID":"d4938739-8be7-47e6-a59e-4db6f550c175","Type":"ContainerStarted","Data":"8c80f6a739b872993a85f0fcc5e278a7d3c1ad77bc085831abb5a9b5a1154bfa"} Jul 07 16:11:49.973851 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:49.973387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxzwv/must-gather-6c7r9" event={"ID":"d4938739-8be7-47e6-a59e-4db6f550c175","Type":"ContainerStarted","Data":"1ef997f32f6bc0f29049f1143cae075273f156a46f7584e7b8311511761b4d76"} Jul 07 16:11:49.996662 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:49.996595 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pxzwv/must-gather-6c7r9" podStartSLOduration=2.032077899 podStartE2EDuration="2.996573724s" totalImagesPullingTime="964.495825ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:11:49.992522349 +0000 UTC m=+2543.415241591" watchObservedRunningTime="2026-07-07 16:11:49.996573724 +0000 UTC m=+2543.419292961" Jul 07 16:11:50.998383 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:50.998355 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xfktn_03c89f85-a9fe-4ac3-beab-8c51f067a9da/global-pull-secret-syncer/0.log" Jul 07 16:11:51.105552 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:51.105517 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bf5s6_e10241ad-8010-43b1-a4d0-5f855868fab7/konnectivity-agent/0.log" Jul 07 16:11:51.187007 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:51.186972 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-86.ec2.internal_de6ff4e436b18660880403245e7c2ccf/haproxy/0.log" Jul 07 16:11:55.640743 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:55.640710 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt_a4e6ab1c-2451-4f47-9059-3302b94f0d45/extract/0.log" Jul 07 16:11:55.693009 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:55.692904 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt_a4e6ab1c-2451-4f47-9059-3302b94f0d45/util/0.log" Jul 07 16:11:55.745759 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:55.745727 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d9wkt_a4e6ab1c-2451-4f47-9059-3302b94f0d45/pull/0.log" Jul 07 16:11:55.813058 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:55.813025 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh_04bee174-3c80-44a6-ba2c-c20f603eb5b3/extract/0.log" Jul 07 16:11:55.881145 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:55.881069 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh_04bee174-3c80-44a6-ba2c-c20f603eb5b3/util/0.log" Jul 07 16:11:55.921305 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:55.921221 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mnjvh_04bee174-3c80-44a6-ba2c-c20f603eb5b3/pull/0.log" Jul 07 16:11:55.962608 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:55.962568 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn_bdce1042-8a7a-481f-8a96-5479fff35f27/extract/0.log" Jul 07 16:11:55.988264 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:55.988229 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn_bdce1042-8a7a-481f-8a96-5479fff35f27/util/0.log" Jul 07 16:11:56.017030 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:56.016989 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73x8vrn_bdce1042-8a7a-481f-8a96-5479fff35f27/pull/0.log" Jul 07 16:11:56.052410 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:56.052378 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k_68deb6dc-a916-4fcb-b9e4-8500af143ce6/extract/0.log" Jul 07 16:11:56.081567 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:56.081491 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k_68deb6dc-a916-4fcb-b9e4-8500af143ce6/util/0.log" Jul 07 16:11:56.109525 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:56.109497 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1gc69k_68deb6dc-a916-4fcb-b9e4-8500af143ce6/pull/0.log" Jul 07 16:11:56.506740 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:56.506691 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66f4798cbc-zdh5k_dad3bd8a-8779-4f72-b95d-026ddf8d819f/authorino/0.log" Jul 07 16:11:56.599730 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:56.599699 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vvpsk_bfdfa166-28a2-4e48-b61c-08791a0e15b0/kuadrant-console-plugin/0.log" Jul 07 16:11:58.615514 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:58.615479 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8c4d921-feff-49e8-9fd0-0335bfd90666/alertmanager/0.log" Jul 07 16:11:58.644739 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:58.644677 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8c4d921-feff-49e8-9fd0-0335bfd90666/config-reloader/0.log" Jul 07 16:11:58.687035 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:58.687000 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8c4d921-feff-49e8-9fd0-0335bfd90666/kube-rbac-proxy-web/0.log" Jul 07 16:11:58.716439 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:58.716408 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8c4d921-feff-49e8-9fd0-0335bfd90666/kube-rbac-proxy/0.log" Jul 07 16:11:58.749256 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:58.749226 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8c4d921-feff-49e8-9fd0-0335bfd90666/kube-rbac-proxy-metric/0.log" Jul 07 16:11:58.784411 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:58.784377 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8c4d921-feff-49e8-9fd0-0335bfd90666/prom-label-proxy/0.log" Jul 07 16:11:58.819358 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:58.819329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8c4d921-feff-49e8-9fd0-0335bfd90666/init-config-reloader/0.log" Jul 07 16:11:59.013571 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:59.013466 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75fc7dff59-55d2r_c135db3c-2d72-48ca-b850-19cdc4102bb8/metrics-server/0.log" Jul 07 16:11:59.044833 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:59.044806 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-gpmrm_27aa0eaf-51c7-461e-98dd-fbfeab0d5ebd/monitoring-plugin/0.log" Jul 07 16:11:59.265097 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:59.265019 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss2nv_4bb3648c-6523-4c71-a46d-12307b1bba1a/node-exporter/0.log" Jul 07 16:11:59.295938 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:59.295916 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss2nv_4bb3648c-6523-4c71-a46d-12307b1bba1a/kube-rbac-proxy/0.log" Jul 07 16:11:59.320846 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:59.320814 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ss2nv_4bb3648c-6523-4c71-a46d-12307b1bba1a/init-textfile/0.log" Jul 07 16:11:59.350970 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:59.350916 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dh547_94d598b0-cd35-42c4-bbb0-cd8db88ab1da/kube-rbac-proxy-main/0.log" Jul 07 16:11:59.379984 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:59.379957 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dh547_94d598b0-cd35-42c4-bbb0-cd8db88ab1da/kube-rbac-proxy-self/0.log" Jul 07 16:11:59.408254 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:11:59.408188 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dh547_94d598b0-cd35-42c4-bbb0-cd8db88ab1da/openshift-state-metrics/0.log" Jul 07 16:12:00.543478 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.543439 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg"] Jul 07 16:12:00.553428 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.553388 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.558926 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.558883 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg"] Jul 07 16:12:00.613350 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.613317 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-lib-modules\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.613547 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.613436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmpbb\" (UniqueName: \"kubernetes.io/projected/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-kube-api-access-dmpbb\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.613547 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.613479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-sys\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.613547 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.613504 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-proc\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.613719 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.613564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-podres\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.714377 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.714338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmpbb\" (UniqueName: \"kubernetes.io/projected/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-kube-api-access-dmpbb\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.714558 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.714415 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-sys\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.714558 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.714445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-proc\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.714558 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.714477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-podres\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.714558 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.714524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-lib-modules\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.714783 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.714727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-proc\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.714783 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.714738 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-lib-modules\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.714892 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.714790 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-sys\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.714892 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.714840 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-podres\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.724701 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.724667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmpbb\" (UniqueName: \"kubernetes.io/projected/1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34-kube-api-access-dmpbb\") pod \"perf-node-gather-daemonset-789xg\" (UID: \"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:00.871177 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:00.870893 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:01.066146 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:01.066082 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg"] Jul 07 16:12:01.072058 ip-10-0-130-86 kubenswrapper[2561]: W0707 16:12:01.071817 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1f4fcf0a_5d0f_46e0_9de0_efd89e60cc34.slice/crio-37b26ad2bd3dd59dbac3feb77fea1e87d55b19a407f08cdd1708b15fe8ca58a6 WatchSource:0}: Error finding container 37b26ad2bd3dd59dbac3feb77fea1e87d55b19a407f08cdd1708b15fe8ca58a6: Status 404 returned error can't find the container with id 37b26ad2bd3dd59dbac3feb77fea1e87d55b19a407f08cdd1708b15fe8ca58a6 Jul 07 16:12:01.187796 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:01.187645 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-tmmp8_4a265fd8-70c8-45ab-93fa-13534e5341e4/networking-console-plugin/0.log" Jul 07 16:12:01.765557 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:01.765522 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/1.log" Jul 07 16:12:01.772157 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:01.772099 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-5fpqh_51844869-9022-4c9a-9fda-412007368c4b/console-operator/2.log" Jul 07 16:12:02.070464 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:02.070386 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" event={"ID":"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34","Type":"ContainerStarted","Data":"15ae5f12fe65932dc24b633ff35dbdc9860e68607ef8252dbf4d5ce3ba058dec"} Jul 07 16:12:02.070464 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:02.070436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" event={"ID":"1f4fcf0a-5d0f-46e0-9de0-efd89e60cc34","Type":"ContainerStarted","Data":"37b26ad2bd3dd59dbac3feb77fea1e87d55b19a407f08cdd1708b15fe8ca58a6"} Jul 07 16:12:02.070684 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:02.070583 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:02.093821 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:02.093756 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" podStartSLOduration=2.093735388 podStartE2EDuration="2.093735388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:12:02.089674043 +0000 UTC m=+2555.512393278" watchObservedRunningTime="2026-07-07 16:12:02.093735388 +0000 UTC m=+2555.516454623" Jul 07 16:12:04.137069 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:04.137032 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lhggt_96351fd9-45ad-49b7-91da-f4a9df652546/dns/0.log" Jul 07 16:12:04.160291 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:04.160262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lhggt_96351fd9-45ad-49b7-91da-f4a9df652546/kube-rbac-proxy/0.log" Jul 07 16:12:04.267035 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:04.267008 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bs9m_c8108322-2c7b-4153-a665-853cabc0ab11/dns-node-resolver/0.log" Jul 07 16:12:04.944665 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:04.944634 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxhl9_151a5f06-a785-4283-861c-1ddf2eea2d55/node-ca/0.log" Jul 07 16:12:06.267230 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:06.267195 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd979f9c8-tb47h_b0ae57d4-b952-4853-ad0b-f151f4c12b3d/kube-auth-proxy/0.log" Jul 07 16:12:06.449159 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:06.449105 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-c4xg5_9bcff40e-139f-46eb-ae0e-9f2ada711949/payload-processing/0.log" Jul 07 16:12:07.244338 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:07.244313 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzcng_de760232-606f-4823-b39c-a721368b2211/serve-healthcheck-canary/0.log" Jul 07 16:12:07.789211 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:07.789181 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-65nf5_a7a20ec3-5611-4473-a9ae-1c4cb1b7987a/insights-operator/0.log" Jul 07 16:12:07.790904 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:07.790880 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-65nf5_a7a20ec3-5611-4473-a9ae-1c4cb1b7987a/insights-operator/1.log" Jul 07 16:12:07.982573 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:07.982549 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xtt2b_88d7dedc-8f35-4dca-9a71-918b2f33d798/kube-rbac-proxy/0.log" Jul 07 16:12:08.017847 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:08.017816 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xtt2b_88d7dedc-8f35-4dca-9a71-918b2f33d798/exporter/0.log" Jul 07 16:12:08.048967 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:08.048889 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xtt2b_88d7dedc-8f35-4dca-9a71-918b2f33d798/extractor/0.log" Jul 07 16:12:08.091600 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:08.091571 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-789xg" Jul 07 16:12:10.796403 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:10.796372 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-54b8744cc8-9pgr6_b3b7a179-d2e6-45bb-9758-51c6c66cb456/maas-api/0.log" Jul 07 16:12:11.158007 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:11.157973 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nfxv4_d84189d7-9972-420e-84cf-42fd69638c86/manager/0.log" Jul 07 16:12:11.186145 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:11.186092 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-95jlw_00c88abe-6c87-4d97-aa5c-70f0d9fb6181/manager/0.log" Jul 07 16:12:11.231972 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:11.231944 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-95jlw_00c88abe-6c87-4d97-aa5c-70f0d9fb6181/copy-manifests/0.log" Jul 07 16:12:11.480481 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:11.480410 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ts5fm_2bf647db-6bb9-44ea-aa8d-fe6751dac406/postgres/0.log" Jul 07 16:12:11.816085 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:11.816018 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd979f9c8-tb47h_b0ae57d4-b952-4853-ad0b-f151f4c12b3d/kube-auth-proxy/0.log" Jul 07 16:12:12.056097 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:12.056065 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-c4xg5_9bcff40e-139f-46eb-ae0e-9f2ada711949/payload-processing/0.log" Jul 07 16:12:12.949349 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:12.949325 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fb8c6bffd-9gcnd_fe699c8c-fca1-4eae-97fa-02389f613083/manager/0.log" Jul 07 16:12:13.004370 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:13.004329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zvl2s_432fc989-ada8-4840-96f3-10cd49cfb264/openshift-lws-operator/0.log" Jul 07 16:12:13.516556 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:13.516526 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd979f9c8-tb47h_b0ae57d4-b952-4853-ad0b-f151f4c12b3d/kube-auth-proxy/0.log" Jul 07 16:12:13.701392 ip-10-0-130-86 kubenswrapper[2561]: I0707 16:12:13.701360 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-c4xg5_9bcff40e-139f-46eb-ae0e-9f2ada711949/payload-processing/0.log"