Jul 07 18:47:43.578831 ip-10-0-133-11 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 18:47:43.578859 ip-10-0-133-11 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 18:47:43.578866 ip-10-0-133-11 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 18:47:43.579082 ip-10-0-133-11 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 18:47:53.799481 ip-10-0-133-11 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 18:47:53.799496 ip-10-0-133-11 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cccc21e18e82420aad2e9831d154455f -- Jul 07 18:49:51.797647 ip-10-0-133-11 systemd[1]: Starting Kubernetes Kubelet... Jul 07 18:49:52.304027 ip-10-0-133-11 systemd[1]: Started Kubernetes Kubelet. Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.223624 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227224 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227237 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227242 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227246 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227251 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227256 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227266 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:52.309716 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227270 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227274 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227278 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227282 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227285 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227289 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227293 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227298 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227303 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227306 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227310 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227314 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227319 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227323 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227327 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227331 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227334 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227338 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227342 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227346 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:52.310545 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227350 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227368 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227372 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227376 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227380 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227383 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227387 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227392 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227395 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227400 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227403 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227407 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227411 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227415 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227418 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227422 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227426 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227430 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227433 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227436 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:52.311530 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227440 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227444 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227447 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227451 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227455 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227459 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227463 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227467 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227471 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227475 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227480 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227484 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227488 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227492 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227496 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227500 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227504 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227509 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227514 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:52.312482 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227520 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227525 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227529 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227533 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227537 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227541 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227545 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227549 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227553 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227556 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227560 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227563 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227567 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227571 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227575 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227579 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227583 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227588 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227592 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227596 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:52.313574 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227599 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227603 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227607 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227611 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227617 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227620 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227624 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227629 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227633 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227636 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227642 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227646 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.227651 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229314 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229323 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229329 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229334 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229339 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229343 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:52.314481 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229347 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229366 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229371 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229376 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229380 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229384 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229387 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229392 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229395 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229399 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229403 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229407 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229410 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229414 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229418 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229422 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229426 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229430 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229434 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:52.315468 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229437 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229441 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229445 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229449 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229453 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229457 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229460 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229463 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229467 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229471 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229474 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229479 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229485 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229490 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229494 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229497 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229503 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229508 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229512 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229515 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:52.316400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229519 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229523 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229527 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229531 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229534 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229538 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229542 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229545 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229549 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229552 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229557 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229560 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229564 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229568 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229571 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229575 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229579 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229582 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229586 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229589 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:52.317456 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229593 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229596 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229600 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229603 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229610 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229614 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229618 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229622 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229626 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229630 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229634 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229637 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229641 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229644 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229648 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229652 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229656 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229660 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229665 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229670 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:52.318701 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229673 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229677 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229687 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229691 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229695 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229702 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229706 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229711 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229717 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229721 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229727 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229731 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229735 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.229739 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230217 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230224 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230232 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230236 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230240 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:52.319806 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230246 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230250 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230254 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230258 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230262 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230266 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230270 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230276 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230281 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230285 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230290 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230294 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230298 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230302 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230305 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230309 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230314 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230317 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230321 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:52.320427 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230325 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230328 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230332 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230336 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230340 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230344 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230348 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230367 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230371 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230375 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230380 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230385 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230389 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230394 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230398 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230401 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230405 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230409 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230413 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230417 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:52.320975 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230421 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230425 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230428 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230432 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230436 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230441 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230445 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230450 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230455 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230459 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230463 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230466 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230470 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230474 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230477 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230481 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230485 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230489 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230492 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:52.322020 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230496 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230499 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230503 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230508 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230512 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230517 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230522 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230526 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230529 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230533 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230538 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230542 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230545 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230549 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230553 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230557 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230560 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230564 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230568 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230571 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:52.324399 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230575 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230578 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230582 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230586 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230591 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230595 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230599 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230602 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230606 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230610 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230613 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230617 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230621 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230627 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230631 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.230637 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230723 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230731 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230743 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230749 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 18:49:52.325152 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230754 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230760 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230766 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230771 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230776 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230780 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230785 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230790 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230794 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230798 2582 flags.go:64] FLAG: --cgroup-root="" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230802 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230806 2582 flags.go:64] FLAG: --client-ca-file="" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230810 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230814 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230820 2582 flags.go:64] FLAG: --cluster-domain="" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230824 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230828 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230832 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230837 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230842 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230847 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230851 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230856 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230860 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 07 18:49:52.325977 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230864 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230868 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230873 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230879 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230891 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230895 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230901 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230907 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230911 2582 flags.go:64] FLAG: --enable-server="true" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230916 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230922 2582 flags.go:64] FLAG: --event-burst="100" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230927 2582 flags.go:64] FLAG: --event-qps="50" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230931 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230936 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230940 2582 flags.go:64] FLAG: --eviction-hard="" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230945 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230950 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230954 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230959 2582 flags.go:64] FLAG: --eviction-soft="" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230963 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230968 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230972 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230976 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230980 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230984 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 18:49:52.326958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230989 2582 flags.go:64] FLAG: --feature-gates="" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230994 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.230998 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231002 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231007 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231012 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231016 2582 flags.go:64] FLAG: --help="false" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231020 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231024 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231029 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231035 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231040 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231044 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231051 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231055 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231061 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231065 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231070 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231074 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231079 2582 flags.go:64] FLAG: --kube-reserved="" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231083 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231087 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231092 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231096 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 18:49:52.328167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231100 2582 flags.go:64] FLAG: --lock-file="" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231104 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231108 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231113 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231120 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231124 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231128 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231132 2582 flags.go:64] FLAG: --logging-format="text" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231136 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231141 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231145 2582 flags.go:64] FLAG: --manifest-url="" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231149 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231155 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231159 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231165 2582 flags.go:64] FLAG: --max-pods="110" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231169 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231174 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231178 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231184 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231188 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231193 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231198 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231207 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231211 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231216 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 18:49:52.331744 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231220 2582 flags.go:64] FLAG: --pod-cidr="" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231224 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231232 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231236 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231241 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231245 2582 flags.go:64] FLAG: --port="10250" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231249 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231254 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-037074e2add546560" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231258 2582 flags.go:64] FLAG: --qos-reserved="" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231263 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231267 2582 flags.go:64] FLAG: --register-node="true" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231271 2582 flags.go:64] FLAG: --register-with-taints="" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231276 2582 flags.go:64] FLAG: --registry-burst="10" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231281 2582 flags.go:64] FLAG: --registry-qps="5" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231285 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231289 2582 flags.go:64] FLAG: --reserved-memory="" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231294 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231299 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231303 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231307 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231311 2582 flags.go:64] FLAG: --runonce="false" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231315 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231320 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231324 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231328 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 18:49:52.332880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231333 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231338 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231343 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231349 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231366 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231371 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231375 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231380 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231384 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231389 2582 flags.go:64] FLAG: --system-cgroups="" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231393 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231400 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231404 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231408 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231413 2582 flags.go:64] FLAG: --tls-min-version="" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231417 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231421 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231425 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231429 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231434 2582 flags.go:64] FLAG: --v="2" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231439 2582 flags.go:64] FLAG: --version="false" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231445 2582 flags.go:64] FLAG: --vmodule="" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231450 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.231454 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231608 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:52.529662 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231612 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231617 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231621 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231624 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231628 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231632 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231636 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231640 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231645 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231649 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231655 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231659 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231663 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231667 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231671 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231676 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231680 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231684 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231688 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:52.543495 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231692 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231696 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231700 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231704 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231707 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231711 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231715 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231719 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231722 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231726 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231730 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231733 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231739 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231745 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231748 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231752 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231755 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231759 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231763 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231766 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:52.544123 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231770 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231776 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231780 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231784 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231788 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231792 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231796 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231800 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231803 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231808 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231812 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231815 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231821 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231826 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231830 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231835 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231839 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231843 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231847 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:52.544786 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231852 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231855 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231859 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231863 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231867 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231871 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231875 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231879 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231883 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231887 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231891 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231895 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231899 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231904 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231911 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231916 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231922 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231926 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231931 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231935 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:52.545369 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231938 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231942 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231946 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231950 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231953 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231957 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231962 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231965 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231969 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231974 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231977 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231981 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231985 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231988 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231992 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.231996 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.232000 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.232004 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.232008 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:52.545978 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.232011 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.233369 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.239841 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.239855 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.239876 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.239885 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239961 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239966 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239970 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239973 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239976 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239979 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239981 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239984 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239987 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:52.546525 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239990 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239993 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239996 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.239998 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240001 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240004 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240006 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240009 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240011 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240014 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240016 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240019 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240021 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240025 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240029 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240033 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240036 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240040 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240043 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240046 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:52.546981 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240048 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240052 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240056 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240059 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240063 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240065 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240068 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240071 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240074 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240076 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240079 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240082 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240084 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240087 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240097 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240100 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240102 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240105 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240108 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:52.547600 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240111 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240113 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240116 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240118 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240121 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240123 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240126 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240131 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240133 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240136 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240139 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240145 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240147 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240150 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240152 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240155 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240158 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240160 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240163 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240165 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:52.548161 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240168 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240170 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240173 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240176 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240179 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240182 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240184 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240188 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240197 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240200 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240203 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240206 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240209 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240211 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240214 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240216 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240219 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240222 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240224 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:52.548890 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240230 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240233 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240235 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240238 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240242 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240244 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240247 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240249 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240252 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240255 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240257 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240260 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.240265 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240411 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240416 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:49:52.549478 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240419 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240422 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240425 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240427 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240430 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240433 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240435 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240445 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240448 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240451 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240453 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240456 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240459 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240461 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240464 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240466 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240469 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240473 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240476 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240478 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:49:52.549908 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240481 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240483 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240487 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240490 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240492 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240495 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240498 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240500 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240503 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240505 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240508 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240511 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240513 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240516 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240519 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240521 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240524 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240527 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240529 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:49:52.550506 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240532 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240540 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240544 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240548 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240550 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240553 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240555 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240558 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240560 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240563 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240566 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240570 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240574 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240576 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240580 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240583 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240586 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240589 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240592 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:49:52.551033 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240594 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240597 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240600 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240602 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240605 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240607 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240610 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240613 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240615 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240618 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240620 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240623 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240625 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240628 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240630 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240640 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240643 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240646 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240649 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240652 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:49:52.551625 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240655 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240658 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240660 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240664 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240667 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240670 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240673 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240675 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240680 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240682 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240685 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240687 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240690 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240692 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240695 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240698 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240701 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240703 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:49:52.552153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:52.240706 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.240711 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.240806 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.245874 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.247582 2582 server.go:1019] "Starting client certificate rotation" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.247677 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.247738 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.249801 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.250863 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.262338 2582 log.go:25] "Validated CRI v1 runtime API" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.264437 2582 log.go:25] "Validated CRI v1 image API" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.265320 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 18:49:52.552700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.270967 2582 fs.go:135] Filesystem UUIDs: map[5a973939-1a74-4264-9c2e-7b97c66f1e66:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 859095e5-3b5d-4c60-a811-a7cc337ead26:/dev/nvme0n1p3] Jul 07 18:49:52.553061 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.270981 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 18:49:52.553165 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.276883 2582 manager.go:216] Machine: {Timestamp:2026-07-07 18:49:52.275099673 +0000 UTC m=+0.334547414 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100330 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f6e48354a642d911c1e936e667170 SystemUUID:ec2f6e48-354a-642d-911c-1e936e667170 BootID:cccc21e1-8e82-420a-ad2e-9831d154455f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:4d:89:e0:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:4d:89:e0:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:dd:57:fe:69:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 18:49:52.553165 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.276985 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 18:49:52.553165 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.277086 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 18:49:52.553165 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.279929 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 18:49:52.553165 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.279957 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-11.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 18:49:52.553165 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.280556 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 18:49:52.553165 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.280566 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 18:49:52.553165 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.280573 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.281924 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.282383 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.283946 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.286821 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.286928 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.286955 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.286966 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.286977 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.286985 2582 kubelet.go:398] "Adding apiserver pod source" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.286994 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.287298 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.287321 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.290777 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.297546 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.297797 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298893 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298906 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298912 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298917 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298925 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298930 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298938 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298943 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298950 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298956 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298968 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.298973 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.299930 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.299945 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.302021 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-11.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.302024 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.302323 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.303158 2582 server.go:1268] "Started kubelet" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.303221 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.303252 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.303316 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.304819 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.305175 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 07 18:49:52.761631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.309050 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-twxlw" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.311667 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.311713 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.311819 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.312171 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.312186 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.312215 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.312285 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.312297 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.313136 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.313146 2582 factory.go:55] Registering systemd factory Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.313153 2582 factory.go:223] Registration of the systemd container factory successfully Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.313778 2582 factory.go:153] Registering CRI-O factory Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.313792 2582 factory.go:223] Registration of the crio container factory successfully Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.313815 2582 factory.go:103] Registering Raw factory Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.313827 2582 manager.go:1196] Started watching for new ooms in manager Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.314302 2582 manager.go:349] Starting recovery of all containers Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.315243 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.319463 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.319814 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.319522 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-11.ec2.internal.18c0168032d4947a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-11.ec2.internal,UID:ip-10-0-133-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-11.ec2.internal,},FirstTimestamp:2026-07-07 18:49:52.303133818 +0000 UTC m=+0.362581559,LastTimestamp:2026-07-07 18:49:52.303133818 +0000 UTC m=+0.362581559,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-11.ec2.internal,}" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.326792 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-twxlw" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.328178 2582 manager.go:354] Recovery completed Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.338031 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.341650 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.341676 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.341693 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.342207 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.342216 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.342220 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.342230 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.342873 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:52.763573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.342920 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.342934 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.343482 2582 policy_none.go:49] "None policy: Start" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.343495 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.343505 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.343827 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-11.ec2.internal.18c0168035207dc5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-11.ec2.internal,UID:ip-10-0-133-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-11.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-11.ec2.internal,},FirstTimestamp:2026-07-07 18:49:52.341663173 +0000 UTC m=+0.401110914,LastTimestamp:2026-07-07 18:49:52.341663173 +0000 UTC m=+0.401110914,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-11.ec2.internal,}" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.344545 2582 policy_none.go:47] "Start" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.383920 2582 manager.go:337] "Starting Device Plugin manager" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.384050 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.384061 2582 server.go:87] "Starting device plugin registration server" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.384256 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.384265 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.384365 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.384443 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.384457 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.384913 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.384962 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.484563 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.485690 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.485721 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.485734 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.485761 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.498055 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.498074 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-11.ec2.internal\": node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.521124 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.523943 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.525107 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.525143 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.525165 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.525203 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.529458 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.621502 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.625982 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal"] Jul 07 18:49:52.765632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.626057 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.626823 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.626843 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.626852 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.628193 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.628311 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.628338 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.628927 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.628952 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.628963 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.628929 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.629040 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.629055 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.630307 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.630334 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.631049 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.631071 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.631082 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.659230 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-11.ec2.internal\" not found" node="ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.663913 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-11.ec2.internal\" not found" node="ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.714533 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9534bd1ba9e0a23b627fcaab9f623fa1-config\") pod \"kube-apiserver-proxy-ip-10-0-133-11.ec2.internal\" (UID: \"9534bd1ba9e0a23b627fcaab9f623fa1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.714555 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.714581 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.766631 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.722144 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.814725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9534bd1ba9e0a23b627fcaab9f623fa1-config\") pod \"kube-apiserver-proxy-ip-10-0-133-11.ec2.internal\" (UID: \"9534bd1ba9e0a23b627fcaab9f623fa1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.814754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.814771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.814820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.814841 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9534bd1ba9e0a23b627fcaab9f623fa1-config\") pod \"kube-apiserver-proxy-ip-10-0-133-11.ec2.internal\" (UID: \"9534bd1ba9e0a23b627fcaab9f623fa1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.814845 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.822348 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:52.923389 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.963449 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" Jul 07 18:49:52.969762 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:52.967888 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" Jul 07 18:49:53.221322 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:53.024474 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:53.221322 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:53.125548 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:53.226710 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.246556 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.246686 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.302747 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.304243 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.307004 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.311981 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.311992 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.327771 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.328790 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.336248 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.336339 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:44:52 +0000 UTC" deadline="2028-04-19 05:39:12.100425522 +0000 UTC" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.336385 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15634h49m18.764043513s" Jul 07 18:49:53.425555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.340783 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 18:49:53.624770 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.431053 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zscsc" Jul 07 18:49:53.624770 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.444819 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zscsc" Jul 07 18:49:53.790785 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:53.679639 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbadb413c950138009b9d470a71bb26b.slice/crio-876d47545dc970dc9af6a54f257093072836b2dd2ad21a1204c66ab3f9538512 WatchSource:0}: Error finding container 876d47545dc970dc9af6a54f257093072836b2dd2ad21a1204c66ab3f9538512: Status 404 returned error can't find the container with id 876d47545dc970dc9af6a54f257093072836b2dd2ad21a1204c66ab3f9538512 Jul 07 18:49:53.790785 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:53.684545 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9534bd1ba9e0a23b627fcaab9f623fa1.slice/crio-41a1122d7333aefb3f4a161c6319fec00ee64caa4bdcb1cfbe0acc7ab3841e4c WatchSource:0}: Error finding container 41a1122d7333aefb3f4a161c6319fec00ee64caa4bdcb1cfbe0acc7ab3841e4c: Status 404 returned error can't find the container with id 41a1122d7333aefb3f4a161c6319fec00ee64caa4bdcb1cfbe0acc7ab3841e4c Jul 07 18:49:53.790785 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:53.685299 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.288109 2582 apiserver.go:52] "Watching apiserver" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.308309 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.308834 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-67wwj","openshift-image-registry/node-ca-lrgzk","openshift-multus/multus-7hr8b","openshift-network-operator/iptables-alerter-tl9vb","openshift-ovn-kubernetes/ovnkube-node-42hq2","kube-system/global-pull-secret-syncer-rxrn4","kube-system/konnectivity-agent-6tspt","kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9xbps","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal","openshift-multus/multus-additional-cni-plugins-4wk8j","openshift-multus/network-metrics-daemon-bpz5n","openshift-network-diagnostics/network-check-target-t59k8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8"] Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.312036 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.314949 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.317507 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.320148 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.322945 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.324943 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.325027 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.327576 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.331242 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.333268 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.335115 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc56a815-1801-4e5a-8fe8-14079115aa5d-tmp-dir\") pod \"node-resolver-67wwj\" (UID: \"dc56a815-1801-4e5a-8fe8-14079115aa5d\") " pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.335149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7vlk\" (UniqueName: \"kubernetes.io/projected/dc56a815-1801-4e5a-8fe8-14079115aa5d-kube-api-access-h7vlk\") pod \"node-resolver-67wwj\" (UID: \"dc56a815-1801-4e5a-8fe8-14079115aa5d\") " pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.335177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5f19387-4025-44c1-a4d8-8ccc995ebd45-serviceca\") pod \"node-ca-lrgzk\" (UID: \"a5f19387-4025-44c1-a4d8-8ccc995ebd45\") " pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.335234 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prh52\" (UniqueName: \"kubernetes.io/projected/a5f19387-4025-44c1-a4d8-8ccc995ebd45-kube-api-access-prh52\") pod \"node-ca-lrgzk\" (UID: \"a5f19387-4025-44c1-a4d8-8ccc995ebd45\") " pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.335271 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc56a815-1801-4e5a-8fe8-14079115aa5d-hosts-file\") pod \"node-resolver-67wwj\" (UID: \"dc56a815-1801-4e5a-8fe8-14079115aa5d\") " pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.335296 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5f19387-4025-44c1-a4d8-8ccc995ebd45-host\") pod \"node-ca-lrgzk\" (UID: \"a5f19387-4025-44c1-a4d8-8ccc995ebd45\") " pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.340352 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.336044 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:54.342878 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.336111 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:49:54.342878 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.338148 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:49:54.342878 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.338208 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:49:54.342878 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.340644 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.350072 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.349657 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pszlz\"" Jul 07 18:49:54.350072 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.349966 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 18:49:54.350853 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.350239 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 18:49:54.350853 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.350541 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 18:49:54.351106 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.350853 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.351109 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.351475 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h4jpk\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.351693 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.351942 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352068 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352094 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lmzcr\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352163 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nrgnd\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352391 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352425 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352452 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352466 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352460 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352831 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.352980 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f5xf6\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353029 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353237 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353305 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353305 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353415 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353459 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353508 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353647 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6bh9s\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353724 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353855 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cp4mh\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353920 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nr8dh\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.353963 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.354117 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.354122 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.354160 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.354262 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sfrvp\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.354345 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 18:49:54.419447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.414001 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.435655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-cni-dir\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.435687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-hostroot\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.435712 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8f07e98-4804-494c-b873-bc425ff06134-env-overrides\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.435735 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cppmr\" (UniqueName: \"kubernetes.io/projected/888c4c27-fde4-4531-af02-c16fd4d465e0-kube-api-access-cppmr\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.435782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.435839 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-cnibin\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.435904 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-registration-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.435957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-run-netns\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.435986 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-log-socket\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436009 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-cni-netd\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436032 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-host\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436057 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-device-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436080 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-system-cni-dir\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.442250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436105 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-run-ovn\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436128 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec-agent-certs\") pod \"konnectivity-agent-6tspt\" (UID: \"96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec\") " pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436155 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlqpk\" (UniqueName: \"kubernetes.io/projected/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-kube-api-access-tlqpk\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436174 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-sys-fs\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436194 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prh52\" (UniqueName: \"kubernetes.io/projected/a5f19387-4025-44c1-a4d8-8ccc995ebd45-kube-api-access-prh52\") pod \"node-ca-lrgzk\" (UID: \"a5f19387-4025-44c1-a4d8-8ccc995ebd45\") " pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-var-lib-cni-bin\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436243 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/840a9218-98b4-4671-bcb8-c210bbf83c15-host-slash\") pod \"iptables-alerter-tl9vb\" (UID: \"840a9218-98b4-4671-bcb8-c210bbf83c15\") " pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436283 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7bt2\" (UniqueName: \"kubernetes.io/projected/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-kube-api-access-w7bt2\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-run-ovn-kubernetes\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436321 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-run-multus-certs\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436342 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-run-systemd\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436357 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-os-release\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-socket-dir-parent\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-node-log\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.443897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436443 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-dbus\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436491 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-conf-dir\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436527 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc56a815-1801-4e5a-8fe8-14079115aa5d-hosts-file\") pod \"node-resolver-67wwj\" (UID: \"dc56a815-1801-4e5a-8fe8-14079115aa5d\") " pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436550 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-kubelet\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec-konnectivity-ca\") pod \"konnectivity-agent-6tspt\" (UID: \"96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec\") " pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-kubernetes\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436653 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-sysctl-conf\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-var-lib-kubelet\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436721 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc56a815-1801-4e5a-8fe8-14079115aa5d-hosts-file\") pod \"node-resolver-67wwj\" (UID: \"dc56a815-1801-4e5a-8fe8-14079115aa5d\") " pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436795 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdmwc\" (UniqueName: \"kubernetes.io/projected/b8f07e98-4804-494c-b873-bc425ff06134-kube-api-access-wdmwc\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-system-cni-dir\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.446219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-os-release\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436901 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-var-lib-kubelet\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436924 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436946 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/888c4c27-fde4-4531-af02-c16fd4d465e0-tmp\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436968 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt4zk\" (UniqueName: \"kubernetes.io/projected/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-kube-api-access-qt4zk\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.436999 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437047 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc56a815-1801-4e5a-8fe8-14079115aa5d-tmp-dir\") pod \"node-resolver-67wwj\" (UID: \"dc56a815-1801-4e5a-8fe8-14079115aa5d\") " pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5f19387-4025-44c1-a4d8-8ccc995ebd45-serviceca\") pod \"node-ca-lrgzk\" (UID: \"a5f19387-4025-44c1-a4d8-8ccc995ebd45\") " pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-cni-binary-copy\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437112 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-run-k8s-cni-cncf-io\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437134 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-run-netns\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437199 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/840a9218-98b4-4671-bcb8-c210bbf83c15-iptables-alerter-script\") pod \"iptables-alerter-tl9vb\" (UID: \"840a9218-98b4-4671-bcb8-c210bbf83c15\") " pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437224 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-daemon-config\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437271 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-etc-kubernetes\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.447380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5f19387-4025-44c1-a4d8-8ccc995ebd45-host\") pod \"node-ca-lrgzk\" (UID: \"a5f19387-4025-44c1-a4d8-8ccc995ebd45\") " pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-var-lib-openvswitch\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8f07e98-4804-494c-b873-bc425ff06134-ovnkube-config\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437359 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-sysctl-d\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437384 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-systemd\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437405 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-run\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-tuned\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437463 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437487 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-systemd-units\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437511 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8f07e98-4804-494c-b873-bc425ff06134-ovnkube-script-lib\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437533 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-sysconfig\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437556 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437580 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.509139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437602 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-socket-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437623 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-cnibin\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437709 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sw26\" (UniqueName: \"kubernetes.io/projected/840a9218-98b4-4671-bcb8-c210bbf83c15-kube-api-access-8sw26\") pod \"iptables-alerter-tl9vb\" (UID: \"840a9218-98b4-4671-bcb8-c210bbf83c15\") " pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437735 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-slash\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437759 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-etc-openvswitch\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f07e98-4804-494c-b873-bc425ff06134-ovn-node-metrics-cert\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-modprobe-d\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437852 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-lib-modules\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437884 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7vlk\" (UniqueName: \"kubernetes.io/projected/dc56a815-1801-4e5a-8fe8-14079115aa5d-kube-api-access-h7vlk\") pod \"node-resolver-67wwj\" (UID: \"dc56a815-1801-4e5a-8fe8-14079115aa5d\") " pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-var-lib-cni-multus\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-run-openvswitch\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437953 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-cni-bin\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-kubelet-config\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:54.510062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.437998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-sys\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.512999 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.438021 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w27t6\" (UniqueName: \"kubernetes.io/projected/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-kube-api-access-w27t6\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.512999 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.438323 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc56a815-1801-4e5a-8fe8-14079115aa5d-tmp-dir\") pod \"node-resolver-67wwj\" (UID: \"dc56a815-1801-4e5a-8fe8-14079115aa5d\") " pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.512999 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.438732 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5f19387-4025-44c1-a4d8-8ccc995ebd45-serviceca\") pod \"node-ca-lrgzk\" (UID: \"a5f19387-4025-44c1-a4d8-8ccc995ebd45\") " pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.512999 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.438795 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5f19387-4025-44c1-a4d8-8ccc995ebd45-host\") pod \"node-ca-lrgzk\" (UID: \"a5f19387-4025-44c1-a4d8-8ccc995ebd45\") " pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.512999 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.446784 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:44:54 +0000 UTC" deadline="2027-12-12 11:29:28.781815701 +0000 UTC" Jul 07 18:49:54.512999 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.446831 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12544h39m34.334990509s" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.516424 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.520681 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7vlk\" (UniqueName: \"kubernetes.io/projected/dc56a815-1801-4e5a-8fe8-14079115aa5d-kube-api-access-h7vlk\") pod \"node-resolver-67wwj\" (UID: \"dc56a815-1801-4e5a-8fe8-14079115aa5d\") " pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.520701 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prh52\" (UniqueName: \"kubernetes.io/projected/a5f19387-4025-44c1-a4d8-8ccc995ebd45-kube-api-access-prh52\") pod \"node-ca-lrgzk\" (UID: \"a5f19387-4025-44c1-a4d8-8ccc995ebd45\") " pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.530483 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" event={"ID":"bbadb413c950138009b9d470a71bb26b","Type":"ContainerStarted","Data":"876d47545dc970dc9af6a54f257093072836b2dd2ad21a1204c66ab3f9538512"} Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.531756 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" event={"ID":"9534bd1ba9e0a23b627fcaab9f623fa1","Type":"ContainerStarted","Data":"41a1122d7333aefb3f4a161c6319fec00ee64caa4bdcb1cfbe0acc7ab3841e4c"} Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.538541 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-run-netns\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.538582 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/840a9218-98b4-4671-bcb8-c210bbf83c15-iptables-alerter-script\") pod \"iptables-alerter-tl9vb\" (UID: \"840a9218-98b4-4671-bcb8-c210bbf83c15\") " pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.538609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-daemon-config\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.538636 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-etc-kubernetes\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.538653 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-run-netns\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.538663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-var-lib-openvswitch\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.538710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8f07e98-4804-494c-b873-bc425ff06134-ovnkube-config\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.538714 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-var-lib-openvswitch\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.538768 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-etc-kubernetes\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.578911 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539255 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/840a9218-98b4-4671-bcb8-c210bbf83c15-iptables-alerter-script\") pod \"iptables-alerter-tl9vb\" (UID: \"840a9218-98b4-4671-bcb8-c210bbf83c15\") " pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539291 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8f07e98-4804-494c-b873-bc425ff06134-ovnkube-config\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539289 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-sysctl-d\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539334 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-systemd\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539306 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-daemon-config\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-run\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539393 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-systemd\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-tuned\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539425 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539400 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-sysctl-d\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539448 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-systemd-units\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8f07e98-4804-494c-b873-bc425ff06134-ovnkube-script-lib\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539499 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-sysconfig\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539497 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-run\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.579859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539524 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539579 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-sysconfig\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-socket-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539628 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-cnibin\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539654 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sw26\" (UniqueName: \"kubernetes.io/projected/840a9218-98b4-4671-bcb8-c210bbf83c15-kube-api-access-8sw26\") pod \"iptables-alerter-tl9vb\" (UID: \"840a9218-98b4-4671-bcb8-c210bbf83c15\") " pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539680 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-slash\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539694 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-socket-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-etc-openvswitch\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539758 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f07e98-4804-494c-b873-bc425ff06134-ovn-node-metrics-cert\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-modprobe-d\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-lib-modules\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.581264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539829 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-var-lib-cni-multus\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539871 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-var-lib-cni-multus\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539875 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-run-openvswitch\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539908 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-cni-bin\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539919 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-cnibin\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539934 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-kubelet-config\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539947 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8f07e98-4804-494c-b873-bc425ff06134-ovnkube-script-lib\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-sys\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539986 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-systemd-units\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.539990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w27t6\" (UniqueName: \"kubernetes.io/projected/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-kube-api-access-w27t6\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540022 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-cni-dir\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540036 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-slash\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540040 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-run-openvswitch\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-hostroot\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.581971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540064 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-etc-openvswitch\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8f07e98-4804-494c-b873-bc425ff06134-env-overrides\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540079 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-kubelet-config\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540120 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540124 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cppmr\" (UniqueName: \"kubernetes.io/projected/888c4c27-fde4-4531-af02-c16fd4d465e0-kube-api-access-cppmr\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540132 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-modprobe-d\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540162 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540184 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-sys\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540189 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-cnibin\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540208 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-hostroot\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-registration-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540249 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-run-netns\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540278 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-cni-bin\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540288 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-lib-modules\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.583149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540164 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540253 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-registration-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540318 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-cnibin\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540278 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-log-socket\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540377 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-cni-netd\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-host\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-device-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540460 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-system-cni-dir\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540464 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-cni-dir\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540485 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-run-ovn\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540505 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-run-netns\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540536 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-log-socket\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540545 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-cni-netd\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540589 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-host\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540630 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-device-dir\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.584791 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.540633 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540650 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8f07e98-4804-494c-b873-bc425ff06134-env-overrides\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540672 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-system-cni-dir\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.540692 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs podName:4444bb12-3fdf-44c0-a2ff-fa21ff8556be nodeName:}" failed. No retries permitted until 2026-07-07 18:49:55.040672278 +0000 UTC m=+3.100120037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs") pod "network-metrics-daemon-bpz5n" (UID: "4444bb12-3fdf-44c0-a2ff-fa21ff8556be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540714 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-run-ovn\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540510 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec-agent-certs\") pod \"konnectivity-agent-6tspt\" (UID: \"96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec\") " pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540749 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlqpk\" (UniqueName: \"kubernetes.io/projected/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-kube-api-access-tlqpk\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540772 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-sys-fs\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540797 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-var-lib-cni-bin\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/840a9218-98b4-4671-bcb8-c210bbf83c15-host-slash\") pod \"iptables-alerter-tl9vb\" (UID: \"840a9218-98b4-4671-bcb8-c210bbf83c15\") " pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7bt2\" (UniqueName: \"kubernetes.io/projected/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-kube-api-access-w7bt2\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540873 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-run-ovn-kubernetes\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540895 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-run-multus-certs\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540913 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-var-lib-cni-bin\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.586841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540920 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-run-systemd\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540952 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-run-systemd\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-os-release\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541021 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-run-multus-certs\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541029 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-socket-dir-parent\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541064 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-node-log\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541068 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-socket-dir-parent\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540988 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-run-ovn-kubernetes\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541078 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-os-release\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541089 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-dbus\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541022 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/840a9218-98b4-4671-bcb8-c210bbf83c15-host-slash\") pod \"iptables-alerter-tl9vb\" (UID: \"840a9218-98b4-4671-bcb8-c210bbf83c15\") " pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.540988 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-sys-fs\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541128 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-node-log\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541153 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-dbus\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.590898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541190 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-conf-dir\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-kubelet\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541236 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec-konnectivity-ca\") pod \"konnectivity-agent-6tspt\" (UID: \"96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec\") " pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541289 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-multus-conf-dir\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541370 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8f07e98-4804-494c-b873-bc425ff06134-host-kubelet\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-kubernetes\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541435 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-sysctl-conf\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541461 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-var-lib-kubelet\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541486 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-kubernetes\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541531 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541558 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdmwc\" (UniqueName: \"kubernetes.io/projected/b8f07e98-4804-494c-b873-bc425ff06134-kube-api-access-wdmwc\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541583 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-system-cni-dir\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.591678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-os-release\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541614 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-sysctl-conf\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541626 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-var-lib-kubelet\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541630 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541664 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-var-lib-kubelet\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541680 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/888c4c27-fde4-4531-af02-c16fd4d465e0-var-lib-kubelet\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541701 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-system-cni-dir\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/888c4c27-fde4-4531-af02-c16fd4d465e0-tmp\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-os-release\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt4zk\" (UniqueName: \"kubernetes.io/projected/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-kube-api-access-qt4zk\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541773 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec-konnectivity-ca\") pod \"konnectivity-agent-6tspt\" (UID: \"96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec\") " pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541791 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.541821 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:54.592316 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.541878 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret podName:a6ab5966-dc6c-45e1-8a34-fa10502ebb56 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:55.041860987 +0000 UTC m=+3.101308742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret") pod "global-pull-secret-syncer-rxrn4" (UID: "a6ab5966-dc6c-45e1-8a34-fa10502ebb56") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:54.592996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541820 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-cni-binary-copy\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.592996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-run-k8s-cni-cncf-io\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.592996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.541970 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-host-run-k8s-cni-cncf-io\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.592996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.542350 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-cni-binary-copy\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.592996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.542394 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.592996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.543065 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8f07e98-4804-494c-b873-bc425ff06134-ovn-node-metrics-cert\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.592996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.544488 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/888c4c27-fde4-4531-af02-c16fd4d465e0-etc-tuned\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.592996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.544843 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec-agent-certs\") pod \"konnectivity-agent-6tspt\" (UID: \"96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec\") " pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:49:54.592996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.545416 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/888c4c27-fde4-4531-af02-c16fd4d465e0-tmp\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.621653 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.621624 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:54.621820 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.621659 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:54.621820 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.621674 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wczlw for pod openshift-network-diagnostics/network-check-target-t59k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:54.621820 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:54.621731 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw podName:f37af844-2b8c-4e3c-8349-4eb2ca35d999 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:55.121714661 +0000 UTC m=+3.181162408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wczlw" (UniqueName: "kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw") pod "network-check-target-t59k8" (UID: "f37af844-2b8c-4e3c-8349-4eb2ca35d999") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:54.625071 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.624830 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-67wwj" Jul 07 18:49:54.625236 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.625207 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlqpk\" (UniqueName: \"kubernetes.io/projected/a1e008c7-4494-4cb3-98d4-7ea7e742eb8f-kube-api-access-tlqpk\") pod \"multus-additional-cni-plugins-4wk8j\" (UID: \"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f\") " pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.625318 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.625253 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w27t6\" (UniqueName: \"kubernetes.io/projected/c25a4751-32f4-4d90-bc36-cf8891ec6a6e-kube-api-access-w27t6\") pod \"aws-ebs-csi-driver-node-qdqz8\" (UID: \"c25a4751-32f4-4d90-bc36-cf8891ec6a6e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.625420 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.625371 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sw26\" (UniqueName: \"kubernetes.io/projected/840a9218-98b4-4671-bcb8-c210bbf83c15-kube-api-access-8sw26\") pod \"iptables-alerter-tl9vb\" (UID: \"840a9218-98b4-4671-bcb8-c210bbf83c15\") " pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.626100 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.626073 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cppmr\" (UniqueName: \"kubernetes.io/projected/888c4c27-fde4-4531-af02-c16fd4d465e0-kube-api-access-cppmr\") pod \"tuned-9xbps\" (UID: \"888c4c27-fde4-4531-af02-c16fd4d465e0\") " pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.627863 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.627516 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt4zk\" (UniqueName: \"kubernetes.io/projected/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-kube-api-access-qt4zk\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:54.627863 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.627607 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7bt2\" (UniqueName: \"kubernetes.io/projected/05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e-kube-api-access-w7bt2\") pod \"multus-7hr8b\" (UID: \"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e\") " pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.628489 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.628201 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdmwc\" (UniqueName: \"kubernetes.io/projected/b8f07e98-4804-494c-b873-bc425ff06134-kube-api-access-wdmwc\") pod \"ovnkube-node-42hq2\" (UID: \"b8f07e98-4804-494c-b873-bc425ff06134\") " pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.634640 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.634621 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrgzk" Jul 07 18:49:54.636604 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:54.636577 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc56a815_1801_4e5a_8fe8_14079115aa5d.slice/crio-5412145e1786d43ec0e184a25770ce4e61bde03e97de8ae3057fd9bfc55d66d1 WatchSource:0}: Error finding container 5412145e1786d43ec0e184a25770ce4e61bde03e97de8ae3057fd9bfc55d66d1: Status 404 returned error can't find the container with id 5412145e1786d43ec0e184a25770ce4e61bde03e97de8ae3057fd9bfc55d66d1 Jul 07 18:49:54.643168 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.643146 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7hr8b" Jul 07 18:49:54.646354 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:54.646330 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f19387_4025_44c1_a4d8_8ccc995ebd45.slice/crio-49a31fad528a5a078c73c4fe2f8c6743698fc03c9316cc16479663af0251c1e0 WatchSource:0}: Error finding container 49a31fad528a5a078c73c4fe2f8c6743698fc03c9316cc16479663af0251c1e0: Status 404 returned error can't find the container with id 49a31fad528a5a078c73c4fe2f8c6743698fc03c9316cc16479663af0251c1e0 Jul 07 18:49:54.652060 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.652030 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tl9vb" Jul 07 18:49:54.654743 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:54.654718 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05cfed71_5ed2_4f8d_bbcd_c3dbfaddc93e.slice/crio-6fbf0c5f330c667fb18709a637b732168b241a4a1842506758d597ba0b5f7145 WatchSource:0}: Error finding container 6fbf0c5f330c667fb18709a637b732168b241a4a1842506758d597ba0b5f7145: Status 404 returned error can't find the container with id 6fbf0c5f330c667fb18709a637b732168b241a4a1842506758d597ba0b5f7145 Jul 07 18:49:54.662107 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.662086 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:49:54.663749 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:54.663722 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840a9218_98b4_4671_bcb8_c210bbf83c15.slice/crio-2b75aed4ecee4fed61bbc2d3b07a1ec62b14c4f6f2906f683865c13debe14efe WatchSource:0}: Error finding container 2b75aed4ecee4fed61bbc2d3b07a1ec62b14c4f6f2906f683865c13debe14efe: Status 404 returned error can't find the container with id 2b75aed4ecee4fed61bbc2d3b07a1ec62b14c4f6f2906f683865c13debe14efe Jul 07 18:49:54.670948 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.670926 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:49:54.673815 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:54.673787 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f07e98_4804_494c_b873_bc425ff06134.slice/crio-2b4a2eea26fa6b0efe517b39487cb817479e5f0e78db2578b7223ce273fa84e1 WatchSource:0}: Error finding container 2b4a2eea26fa6b0efe517b39487cb817479e5f0e78db2578b7223ce273fa84e1: Status 404 returned error can't find the container with id 2b4a2eea26fa6b0efe517b39487cb817479e5f0e78db2578b7223ce273fa84e1 Jul 07 18:49:54.680150 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.679917 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xbps" Jul 07 18:49:54.684026 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:54.683965 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e0f7c3_2129_4fbe_b8b0_f98c40dfdeec.slice/crio-816f7ad83ea09d158c01da5555af076c45d2710e8f0a4816ddb42f3944b2b3c7 WatchSource:0}: Error finding container 816f7ad83ea09d158c01da5555af076c45d2710e8f0a4816ddb42f3944b2b3c7: Status 404 returned error can't find the container with id 816f7ad83ea09d158c01da5555af076c45d2710e8f0a4816ddb42f3944b2b3c7 Jul 07 18:49:54.690813 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.690636 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" Jul 07 18:49:54.691400 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:54.691354 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888c4c27_fde4_4531_af02_c16fd4d465e0.slice/crio-74d3a6d91a89b62b619d3401d4af8bf58d7e4430286a326b7827a768c359c0a4 WatchSource:0}: Error finding container 74d3a6d91a89b62b619d3401d4af8bf58d7e4430286a326b7827a768c359c0a4: Status 404 returned error can't find the container with id 74d3a6d91a89b62b619d3401d4af8bf58d7e4430286a326b7827a768c359c0a4 Jul 07 18:49:54.698697 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.698679 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" Jul 07 18:49:54.700273 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:49:54.700254 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e008c7_4494_4cb3_98d4_7ea7e742eb8f.slice/crio-572dcc8b8b1ba25135515df6dd2f2d167f0d30173628d19e1671ef257ea82a5c WatchSource:0}: Error finding container 572dcc8b8b1ba25135515df6dd2f2d167f0d30173628d19e1671ef257ea82a5c: Status 404 returned error can't find the container with id 572dcc8b8b1ba25135515df6dd2f2d167f0d30173628d19e1671ef257ea82a5c Jul 07 18:49:54.796901 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:54.796829 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:49:55.045615 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.045583 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:55.045807 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.045639 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:55.045807 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.045740 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:55.045807 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.045746 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:55.045807 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.045797 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret podName:a6ab5966-dc6c-45e1-8a34-fa10502ebb56 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:56.045782387 +0000 UTC m=+4.105230118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret") pod "global-pull-secret-syncer-rxrn4" (UID: "a6ab5966-dc6c-45e1-8a34-fa10502ebb56") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:55.045807 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.045812 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs podName:4444bb12-3fdf-44c0-a2ff-fa21ff8556be nodeName:}" failed. No retries permitted until 2026-07-07 18:49:56.045805147 +0000 UTC m=+4.105252877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs") pod "network-metrics-daemon-bpz5n" (UID: "4444bb12-3fdf-44c0-a2ff-fa21ff8556be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:55.146311 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.146275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:49:55.146527 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.146442 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:55.146527 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.146461 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:55.146527 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.146473 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wczlw for pod openshift-network-diagnostics/network-check-target-t59k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:55.146696 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.146536 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw podName:f37af844-2b8c-4e3c-8349-4eb2ca35d999 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:56.146518378 +0000 UTC m=+4.205966109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wczlw" (UniqueName: "kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw") pod "network-check-target-t59k8" (UID: "f37af844-2b8c-4e3c-8349-4eb2ca35d999") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:55.447942 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.447805 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:44:54 +0000 UTC" deadline="2028-04-10 13:35:27.822000176 +0000 UTC" Jul 07 18:49:55.447942 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.447871 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15426h45m32.374133699s" Jul 07 18:49:55.526858 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.526190 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:49:55.526858 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.526240 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:55.526858 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.526340 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:49:55.526858 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:55.526812 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:49:55.537010 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.536974 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xbps" event={"ID":"888c4c27-fde4-4531-af02-c16fd4d465e0","Type":"ContainerStarted","Data":"74d3a6d91a89b62b619d3401d4af8bf58d7e4430286a326b7827a768c359c0a4"} Jul 07 18:49:55.538699 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.538623 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6tspt" event={"ID":"96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec","Type":"ContainerStarted","Data":"816f7ad83ea09d158c01da5555af076c45d2710e8f0a4816ddb42f3944b2b3c7"} Jul 07 18:49:55.540586 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.540559 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" event={"ID":"b8f07e98-4804-494c-b873-bc425ff06134","Type":"ContainerStarted","Data":"2b4a2eea26fa6b0efe517b39487cb817479e5f0e78db2578b7223ce273fa84e1"} Jul 07 18:49:55.542238 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.542209 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tl9vb" event={"ID":"840a9218-98b4-4671-bcb8-c210bbf83c15","Type":"ContainerStarted","Data":"2b75aed4ecee4fed61bbc2d3b07a1ec62b14c4f6f2906f683865c13debe14efe"} Jul 07 18:49:55.543750 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.543687 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrgzk" event={"ID":"a5f19387-4025-44c1-a4d8-8ccc995ebd45","Type":"ContainerStarted","Data":"49a31fad528a5a078c73c4fe2f8c6743698fc03c9316cc16479663af0251c1e0"} Jul 07 18:49:55.545240 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.545186 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-67wwj" event={"ID":"dc56a815-1801-4e5a-8fe8-14079115aa5d","Type":"ContainerStarted","Data":"5412145e1786d43ec0e184a25770ce4e61bde03e97de8ae3057fd9bfc55d66d1"} Jul 07 18:49:55.546838 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.546769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" event={"ID":"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f","Type":"ContainerStarted","Data":"572dcc8b8b1ba25135515df6dd2f2d167f0d30173628d19e1671ef257ea82a5c"} Jul 07 18:49:55.548531 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:55.548468 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7hr8b" event={"ID":"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e","Type":"ContainerStarted","Data":"6fbf0c5f330c667fb18709a637b732168b241a4a1842506758d597ba0b5f7145"} Jul 07 18:49:56.054197 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:56.053354 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:56.054197 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:56.053449 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:56.054197 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:56.053610 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:56.054197 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:56.053678 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs podName:4444bb12-3fdf-44c0-a2ff-fa21ff8556be nodeName:}" failed. No retries permitted until 2026-07-07 18:49:58.053657952 +0000 UTC m=+6.113105690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs") pod "network-metrics-daemon-bpz5n" (UID: "4444bb12-3fdf-44c0-a2ff-fa21ff8556be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:56.054197 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:56.054093 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:56.054197 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:56.054146 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret podName:a6ab5966-dc6c-45e1-8a34-fa10502ebb56 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:58.054130254 +0000 UTC m=+6.113577984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret") pod "global-pull-secret-syncer-rxrn4" (UID: "a6ab5966-dc6c-45e1-8a34-fa10502ebb56") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:56.153870 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:56.153827 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:49:56.154052 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:56.154017 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:56.154052 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:56.154038 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:56.154190 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:56.154054 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wczlw for pod openshift-network-diagnostics/network-check-target-t59k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:56.154190 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:56.154114 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw podName:f37af844-2b8c-4e3c-8349-4eb2ca35d999 nodeName:}" failed. No retries permitted until 2026-07-07 18:49:58.154095278 +0000 UTC m=+6.213543029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wczlw" (UniqueName: "kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw") pod "network-check-target-t59k8" (UID: "f37af844-2b8c-4e3c-8349-4eb2ca35d999") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:56.526696 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:56.526138 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:56.526696 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:56.526292 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:49:56.554527 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:56.554448 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" event={"ID":"c25a4751-32f4-4d90-bc36-cf8891ec6a6e","Type":"ContainerStarted","Data":"815644c911b18ecca029146bf2aa7f70b2c4552b5cda421ec5e52faf3cb6ac45"} Jul 07 18:49:57.526780 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:57.526113 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:49:57.526780 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:57.526254 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:49:57.526780 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:57.526325 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:57.526780 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:57.526425 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:49:58.071591 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:58.070709 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:58.071591 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:58.070812 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:58.071591 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:58.070945 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:58.071591 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:58.071007 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret podName:a6ab5966-dc6c-45e1-8a34-fa10502ebb56 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:02.070988389 +0000 UTC m=+10.130436123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret") pod "global-pull-secret-syncer-rxrn4" (UID: "a6ab5966-dc6c-45e1-8a34-fa10502ebb56") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:49:58.071591 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:58.071503 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:58.071591 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:58.071566 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs podName:4444bb12-3fdf-44c0-a2ff-fa21ff8556be nodeName:}" failed. No retries permitted until 2026-07-07 18:50:02.071547912 +0000 UTC m=+10.130995665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs") pod "network-metrics-daemon-bpz5n" (UID: "4444bb12-3fdf-44c0-a2ff-fa21ff8556be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:49:58.171769 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:58.171729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:49:58.172029 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:58.172007 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:49:58.172099 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:58.172038 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:49:58.172099 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:58.172053 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wczlw for pod openshift-network-diagnostics/network-check-target-t59k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:58.172207 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:58.172117 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw podName:f37af844-2b8c-4e3c-8349-4eb2ca35d999 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:02.17209651 +0000 UTC m=+10.231544248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wczlw" (UniqueName: "kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw") pod "network-check-target-t59k8" (UID: "f37af844-2b8c-4e3c-8349-4eb2ca35d999") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:49:58.526655 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:58.526625 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:49:58.526857 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:58.526770 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:49:59.525852 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:59.525771 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:49:59.526043 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:59.525911 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:49:59.526469 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:49:59.526297 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:49:59.526469 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:49:59.526398 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:00.528165 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:00.527664 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:00.528165 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:00.527816 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:01.526029 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:01.525990 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:01.526222 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:01.526033 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:01.526222 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:01.526131 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:01.526336 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:01.526275 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:02.104242 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:02.104192 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:02.104722 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:02.104259 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:02.104722 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:02.104394 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:50:02.104722 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:02.104457 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs podName:4444bb12-3fdf-44c0-a2ff-fa21ff8556be nodeName:}" failed. No retries permitted until 2026-07-07 18:50:10.104438223 +0000 UTC m=+18.163885960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs") pod "network-metrics-daemon-bpz5n" (UID: "4444bb12-3fdf-44c0-a2ff-fa21ff8556be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:50:02.104722 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:02.104519 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:50:02.104722 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:02.104551 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret podName:a6ab5966-dc6c-45e1-8a34-fa10502ebb56 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:10.104539986 +0000 UTC m=+18.163987716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret") pod "global-pull-secret-syncer-rxrn4" (UID: "a6ab5966-dc6c-45e1-8a34-fa10502ebb56") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:50:02.205060 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:02.205020 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:02.205230 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:02.205214 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:50:02.205316 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:02.205240 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:50:02.205316 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:02.205254 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wczlw for pod openshift-network-diagnostics/network-check-target-t59k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:50:02.205445 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:02.205316 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw podName:f37af844-2b8c-4e3c-8349-4eb2ca35d999 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:10.205301271 +0000 UTC m=+18.264749017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wczlw" (UniqueName: "kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw") pod "network-check-target-t59k8" (UID: "f37af844-2b8c-4e3c-8349-4eb2ca35d999") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:50:02.526818 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:02.526641 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:02.526818 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:02.526771 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:03.526202 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:03.526161 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:03.526664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:03.526161 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:03.526664 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:03.526301 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:03.526664 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:03.526404 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:04.526170 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:04.525950 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:04.526379 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:04.526274 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:05.526303 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:05.526219 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:05.526303 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:05.526226 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:05.526905 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:05.526383 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:05.526905 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:05.526794 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:06.526185 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:06.526148 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:06.526375 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:06.526298 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:07.526411 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:07.526367 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:07.526849 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:07.526368 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:07.526849 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:07.526516 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:07.526849 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:07.526594 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:08.526110 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:08.526077 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:08.526280 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:08.526234 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:09.526118 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:09.526089 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:09.526617 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:09.526211 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:09.526617 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:09.526278 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:09.526617 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:09.526397 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:10.164588 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:10.164493 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:10.164724 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:10.164637 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:50:10.164724 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:10.164672 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:10.164724 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:10.164703 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs podName:4444bb12-3fdf-44c0-a2ff-fa21ff8556be nodeName:}" failed. No retries permitted until 2026-07-07 18:50:26.164682481 +0000 UTC m=+34.224130236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs") pod "network-metrics-daemon-bpz5n" (UID: "4444bb12-3fdf-44c0-a2ff-fa21ff8556be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:50:10.164885 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:10.164770 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:50:10.164885 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:10.164818 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret podName:a6ab5966-dc6c-45e1-8a34-fa10502ebb56 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:26.1648036 +0000 UTC m=+34.224251333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret") pod "global-pull-secret-syncer-rxrn4" (UID: "a6ab5966-dc6c-45e1-8a34-fa10502ebb56") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:50:10.265819 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:10.265777 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:10.265973 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:10.265949 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:50:10.265973 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:10.265972 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:50:10.266037 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:10.265981 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wczlw for pod openshift-network-diagnostics/network-check-target-t59k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:50:10.266076 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:10.266037 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw podName:f37af844-2b8c-4e3c-8349-4eb2ca35d999 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:26.266022073 +0000 UTC m=+34.325469804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wczlw" (UniqueName: "kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw") pod "network-check-target-t59k8" (UID: "f37af844-2b8c-4e3c-8349-4eb2ca35d999") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:50:10.525995 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:10.525926 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:10.526147 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:10.526056 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:11.526072 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:11.525964 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:11.526238 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:11.526086 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:11.526238 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:11.526152 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:11.526627 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:11.526278 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:12.526487 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:12.526448 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:12.526883 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:12.526579 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:13.526394 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:13.526362 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:13.526580 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:13.526350 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:13.526580 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:13.526485 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:13.526918 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:13.526585 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:14.525697 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:14.525673 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:14.525800 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:14.525783 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:14.602996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:14.602968 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" event={"ID":"9534bd1ba9e0a23b627fcaab9f623fa1","Type":"ContainerStarted","Data":"0f46ac880b088bbf44ee77a50ab663fcc806c63539c0be22e2d1c51882a70558"} Jul 07 18:50:14.604454 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:14.604428 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xbps" event={"ID":"888c4c27-fde4-4531-af02-c16fd4d465e0","Type":"ContainerStarted","Data":"a4d2752e45d150128f801dee7ba532e6b8aa05d9aa9839c103b4489410193338"} Jul 07 18:50:14.605718 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:14.605690 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7hr8b" event={"ID":"05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e","Type":"ContainerStarted","Data":"75df67bc2e8775d2d5d07f6c9d4e106f46b572d1c30c797ed755547e547c6659"} Jul 07 18:50:14.623786 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:14.623740 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" podStartSLOduration=21.623728842 podStartE2EDuration="21.623728842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:14.623442246 +0000 UTC m=+22.682889997" watchObservedRunningTime="2026-07-07 18:50:14.623728842 +0000 UTC m=+22.683176593" Jul 07 18:50:14.657627 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:14.657586 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9xbps" podStartSLOduration=2.064447368 podStartE2EDuration="21.657570104s" totalImagesPullingTime="19.593122736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:14.657250322 +0000 UTC m=+22.716698073" watchObservedRunningTime="2026-07-07 18:50:14.657570104 +0000 UTC m=+22.717017855" Jul 07 18:50:14.683754 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:14.683714 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7hr8b" podStartSLOduration=2.034693711 podStartE2EDuration="21.683699357s" totalImagesPullingTime="19.649005646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:14.683615578 +0000 UTC m=+22.743063330" watchObservedRunningTime="2026-07-07 18:50:14.683699357 +0000 UTC m=+22.743147108" Jul 07 18:50:15.525943 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.525764 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:15.526169 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.525839 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:15.526169 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:15.526007 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:15.526169 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:15.526109 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:15.609131 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.609102 2582 generic.go:356] "Generic (PLEG): container finished" podID="bbadb413c950138009b9d470a71bb26b" containerID="244240a92013dcd73ef3a9f1d6d29225235ceddd296056e1e15dd63e242b46e9" exitCode=0 Jul 07 18:50:15.609708 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.609178 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" event={"ID":"bbadb413c950138009b9d470a71bb26b","Type":"ContainerDied","Data":"244240a92013dcd73ef3a9f1d6d29225235ceddd296056e1e15dd63e242b46e9"} Jul 07 18:50:15.610736 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.610705 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6tspt" event={"ID":"96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec","Type":"ContainerStarted","Data":"41fbadb9cbea49730dc5566fa3728c8546012a49c5773227a440bda52ced08a9"} Jul 07 18:50:15.615459 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.615434 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" event={"ID":"b8f07e98-4804-494c-b873-bc425ff06134","Type":"ContainerStarted","Data":"c7b68d1b9e45f4ecef6e2cbc02d1b4a547a754873f9d9111eac46b4c82c3db73"} Jul 07 18:50:15.615583 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.615508 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" event={"ID":"b8f07e98-4804-494c-b873-bc425ff06134","Type":"ContainerStarted","Data":"ea935fe04d027ff892f4c86a9cd7c93eb37f340197e229ab3c58caff1600fa31"} Jul 07 18:50:15.615583 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.615556 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" event={"ID":"b8f07e98-4804-494c-b873-bc425ff06134","Type":"ContainerStarted","Data":"95adb9acaeb2184ffa9c82d282cc8d41cfd5153c7405f64cde59abf93d7772ab"} Jul 07 18:50:15.615678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.615586 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" event={"ID":"b8f07e98-4804-494c-b873-bc425ff06134","Type":"ContainerStarted","Data":"b065b9a79a8056eb0a0e68aab701d6e979606672474553b91d85514e639461b7"} Jul 07 18:50:15.615678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.615615 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" event={"ID":"b8f07e98-4804-494c-b873-bc425ff06134","Type":"ContainerStarted","Data":"835dc3563be06169efdf1e1d22051553a095e83c4bca055807f53342a8fe22b2"} Jul 07 18:50:15.615678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.615659 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" event={"ID":"b8f07e98-4804-494c-b873-bc425ff06134","Type":"ContainerStarted","Data":"d7dd755a071cfb1b7ffd0094d330cfba84c2787f8511f985f66e6679b2f40602"} Jul 07 18:50:15.616701 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.616675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tl9vb" event={"ID":"840a9218-98b4-4671-bcb8-c210bbf83c15","Type":"ContainerStarted","Data":"ea7f249c692f2b85f2867a6a2e0343af6a683a07dc948f9765e4086e00e242aa"} Jul 07 18:50:15.618054 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.618021 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrgzk" event={"ID":"a5f19387-4025-44c1-a4d8-8ccc995ebd45","Type":"ContainerStarted","Data":"78214303fb2b91857f1d39222057ea5961c6522d5684387fb3a8191dacb8ecad"} Jul 07 18:50:15.619380 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.619343 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-67wwj" event={"ID":"dc56a815-1801-4e5a-8fe8-14079115aa5d","Type":"ContainerStarted","Data":"ca8b33095aea29d9f2311902456df51e97438ce530a7371d57215ffc6737d992"} Jul 07 18:50:15.620801 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.620777 2582 generic.go:356] "Generic (PLEG): container finished" podID="a1e008c7-4494-4cb3-98d4-7ea7e742eb8f" containerID="8cb9f85c349a430abaf8bd97bd0bc93b648be0a94488b7afc7856824d5d5bcdf" exitCode=0 Jul 07 18:50:15.620920 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.620844 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" event={"ID":"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f","Type":"ContainerDied","Data":"8cb9f85c349a430abaf8bd97bd0bc93b648be0a94488b7afc7856824d5d5bcdf"} Jul 07 18:50:15.622193 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.622172 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" event={"ID":"c25a4751-32f4-4d90-bc36-cf8891ec6a6e","Type":"ContainerStarted","Data":"1a4202ab7dcb377522865681ae17d29e575174daae6af705e77e8559e540ed4f"} Jul 07 18:50:15.689332 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.689280 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lrgzk" podStartSLOduration=12.281703568 podStartE2EDuration="22.689260992s" totalImagesPullingTime="10.407557424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:15.666673247 +0000 UTC m=+23.726120998" watchObservedRunningTime="2026-07-07 18:50:15.689260992 +0000 UTC m=+23.748708747" Jul 07 18:50:15.689522 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.689491 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tl9vb" podStartSLOduration=3.069297229 podStartE2EDuration="22.689478787s" totalImagesPullingTime="19.620181558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:15.689379507 +0000 UTC m=+23.748827259" watchObservedRunningTime="2026-07-07 18:50:15.689478787 +0000 UTC m=+23.748926538" Jul 07 18:50:15.752202 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.752153 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6tspt" podStartSLOduration=8.403873483 podStartE2EDuration="22.75213789s" totalImagesPullingTime="14.348264407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:15.71871551 +0000 UTC m=+23.778163260" watchObservedRunningTime="2026-07-07 18:50:15.75213789 +0000 UTC m=+23.811585641" Jul 07 18:50:15.784676 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.784630 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-67wwj" podStartSLOduration=3.137890889 podStartE2EDuration="22.784614113s" totalImagesPullingTime="19.646723224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:15.752624623 +0000 UTC m=+23.812072373" watchObservedRunningTime="2026-07-07 18:50:15.784614113 +0000 UTC m=+23.844061902" Jul 07 18:50:15.839559 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.839522 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:15.933906 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:15.933827 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:16.187482 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:16.187388 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:16.258736 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:16.258698 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:16.526381 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:16.526345 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:16.526540 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:16.526467 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:16.603281 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:16.603183 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 18:50:16.626082 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:16.626048 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" event={"ID":"c25a4751-32f4-4d90-bc36-cf8891ec6a6e","Type":"ContainerStarted","Data":"fcb223cb22511e7902f13dd90097775be29c993a77f5e8ecf746e439379cd367"} Jul 07 18:50:16.627940 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:16.627912 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" event={"ID":"bbadb413c950138009b9d470a71bb26b","Type":"ContainerStarted","Data":"177d888f7b6409a3243aad015424a7536099a4efbeb690e8c922b0f61deec446"} Jul 07 18:50:16.647087 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:16.647050 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" podStartSLOduration=23.647037187 podStartE2EDuration="23.647037187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:16.646636707 +0000 UTC m=+24.706084459" watchObservedRunningTime="2026-07-07 18:50:16.647037187 +0000 UTC m=+24.706484937" Jul 07 18:50:17.399660 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:17.399547 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T18:50:16.603197422Z","UUID":"6e95bdb8-e8b3-4342-a0bb-f2c702f81278","Handler":null,"Name":"","Endpoint":""} Jul 07 18:50:17.401298 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:17.401271 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 18:50:17.401439 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:17.401315 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 18:50:17.525514 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:17.525470 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:17.525680 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:17.525599 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:17.525741 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:17.525689 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:17.525741 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:17.525593 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:18.141162 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:18.141133 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:50:18.141806 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:18.141788 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:50:18.525714 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:18.525644 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:18.525845 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:18.525756 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:18.636560 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:18.636520 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" event={"ID":"b8f07e98-4804-494c-b873-bc425ff06134","Type":"ContainerStarted","Data":"413ef8b2d40ff1bbaa5529cc72517d49e43d4e1d71a6822ca33a65b28a2ee5aa"} Jul 07 18:50:18.638757 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:18.638719 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" event={"ID":"c25a4751-32f4-4d90-bc36-cf8891ec6a6e","Type":"ContainerStarted","Data":"f1dbf8508c7887830618f49931c518b2133c64c23bc5a75651e5a9cca92bb136"} Jul 07 18:50:19.526082 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:19.526044 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:19.526082 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:19.526064 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:19.526536 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:19.526144 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:19.526536 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:19.526279 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:20.526137 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:20.526062 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:20.526525 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:20.526193 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:21.526277 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:21.526165 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:21.526277 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:21.526165 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:21.526907 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:21.526281 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:21.526907 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:21.526335 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:21.648740 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:21.648703 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" event={"ID":"b8f07e98-4804-494c-b873-bc425ff06134","Type":"ContainerStarted","Data":"56c76e3d25cd3503c25067026e259ff431140b58ac947e65b50d3ad80572fcb1"} Jul 07 18:50:21.648930 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:21.648913 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:50:21.650508 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:21.650482 2582 generic.go:356] "Generic (PLEG): container finished" podID="a1e008c7-4494-4cb3-98d4-7ea7e742eb8f" containerID="78acf9f5c151ae0b86f1c1a9daa184ff837f0076457f4398936409ba56b91054" exitCode=0 Jul 07 18:50:21.650508 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:21.650518 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" event={"ID":"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f","Type":"ContainerDied","Data":"78acf9f5c151ae0b86f1c1a9daa184ff837f0076457f4398936409ba56b91054"} Jul 07 18:50:21.664134 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:21.664115 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:50:21.680473 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:21.680438 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdqz8" podStartSLOduration=8.271714587 podStartE2EDuration="28.680426384s" totalImagesPullingTime="20.408711797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:18.660028047 +0000 UTC m=+26.719475798" watchObservedRunningTime="2026-07-07 18:50:21.680426384 +0000 UTC m=+29.739874135" Jul 07 18:50:21.680681 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:21.680663 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" podStartSLOduration=8.593176646 podStartE2EDuration="28.680659846s" totalImagesPullingTime="20.0874832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:21.680254641 +0000 UTC m=+29.739702403" watchObservedRunningTime="2026-07-07 18:50:21.680659846 +0000 UTC m=+29.740107597" Jul 07 18:50:22.520910 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.520872 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:50:22.521118 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.521064 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 18:50:22.521898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.521868 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6tspt" Jul 07 18:50:22.525731 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.525707 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:22.525861 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:22.525835 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:22.591639 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.591607 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:22.653161 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.653137 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:50:22.653585 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.653564 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:50:22.667117 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.667098 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:50:22.960049 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.960019 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bpz5n"] Jul 07 18:50:22.960204 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.960186 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:22.960376 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:22.960323 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:22.962051 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.962026 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t59k8"] Jul 07 18:50:22.962149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.962135 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:22.962267 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:22.962230 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:22.962619 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.962602 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxrn4"] Jul 07 18:50:22.962687 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:22.962677 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:22.962762 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:22.962742 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:23.656454 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:23.656418 2582 generic.go:356] "Generic (PLEG): container finished" podID="a1e008c7-4494-4cb3-98d4-7ea7e742eb8f" containerID="7a2f1f2ebbfd722896cd3f76686a1adacd51ddc04356770afc8cf0da8de94660" exitCode=0 Jul 07 18:50:23.656931 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:23.656500 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" event={"ID":"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f","Type":"ContainerDied","Data":"7a2f1f2ebbfd722896cd3f76686a1adacd51ddc04356770afc8cf0da8de94660"} Jul 07 18:50:24.525766 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:24.525546 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:24.525925 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:24.525554 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:24.525925 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:24.525786 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:24.525925 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:24.525554 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:24.525925 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:24.525891 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:24.526114 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:24.525932 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:25.666391 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:25.666341 2582 generic.go:356] "Generic (PLEG): container finished" podID="a1e008c7-4494-4cb3-98d4-7ea7e742eb8f" containerID="f7c5fc19e647adac1d59b8808b44e7774acfdd2cb05504027e9a3a04a51435ef" exitCode=0 Jul 07 18:50:25.666852 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:25.666390 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" event={"ID":"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f","Type":"ContainerDied","Data":"f7c5fc19e647adac1d59b8808b44e7774acfdd2cb05504027e9a3a04a51435ef"} Jul 07 18:50:26.183935 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:26.183891 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:26.184103 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:26.183949 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:26.184103 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.184066 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:50:26.184103 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.184069 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:50:26.184258 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.184125 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret podName:a6ab5966-dc6c-45e1-8a34-fa10502ebb56 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:58.184106593 +0000 UTC m=+66.243554322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret") pod "global-pull-secret-syncer-rxrn4" (UID: "a6ab5966-dc6c-45e1-8a34-fa10502ebb56") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:50:26.184258 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.184145 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs podName:4444bb12-3fdf-44c0-a2ff-fa21ff8556be nodeName:}" failed. No retries permitted until 2026-07-07 18:50:58.184135512 +0000 UTC m=+66.243583246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs") pod "network-metrics-daemon-bpz5n" (UID: "4444bb12-3fdf-44c0-a2ff-fa21ff8556be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:50:26.284467 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:26.284382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:26.284618 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.284563 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:50:26.284618 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.284589 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:50:26.284618 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.284601 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wczlw for pod openshift-network-diagnostics/network-check-target-t59k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:50:26.284786 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.284663 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw podName:f37af844-2b8c-4e3c-8349-4eb2ca35d999 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:58.284644191 +0000 UTC m=+66.344091939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wczlw" (UniqueName: "kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw") pod "network-check-target-t59k8" (UID: "f37af844-2b8c-4e3c-8349-4eb2ca35d999") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:50:26.526264 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:26.526232 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:26.526447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:26.526232 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:26.526447 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.526347 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rxrn4" podUID="a6ab5966-dc6c-45e1-8a34-fa10502ebb56" Jul 07 18:50:26.526556 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.526455 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpz5n" podUID="4444bb12-3fdf-44c0-a2ff-fa21ff8556be" Jul 07 18:50:26.526556 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:26.526241 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:26.526556 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:26.526546 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t59k8" podUID="f37af844-2b8c-4e3c-8349-4eb2ca35d999" Jul 07 18:50:27.161049 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.161020 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeReady" Jul 07 18:50:27.161495 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.161141 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 18:50:27.215533 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.215500 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z5nhx"] Jul 07 18:50:27.217564 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.217541 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x7sql"] Jul 07 18:50:27.217689 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.217669 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.219322 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.219301 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7sql" Jul 07 18:50:27.219844 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.219828 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 18:50:27.220013 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.219828 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 18:50:27.220311 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.220289 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krxdw\"" Jul 07 18:50:27.221368 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.221332 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 18:50:27.221704 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.221679 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 18:50:27.221797 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.221685 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9shx6\"" Jul 07 18:50:27.221797 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.221752 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 18:50:27.228555 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.228533 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7sql"] Jul 07 18:50:27.229178 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.229161 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z5nhx"] Jul 07 18:50:27.393017 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.392987 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.393017 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.393017 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-config-volume\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.393202 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.393033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-tmp-dir\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.393202 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.393055 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/364faadd-a345-4965-bef1-4b5e0bff06fd-cert\") pod \"ingress-canary-x7sql\" (UID: \"364faadd-a345-4965-bef1-4b5e0bff06fd\") " pod="openshift-ingress-canary/ingress-canary-x7sql" Jul 07 18:50:27.393202 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.393101 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f58q\" (UniqueName: \"kubernetes.io/projected/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-kube-api-access-2f58q\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.393294 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.393205 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566dw\" (UniqueName: \"kubernetes.io/projected/364faadd-a345-4965-bef1-4b5e0bff06fd-kube-api-access-566dw\") pod \"ingress-canary-x7sql\" (UID: \"364faadd-a345-4965-bef1-4b5e0bff06fd\") " pod="openshift-ingress-canary/ingress-canary-x7sql" Jul 07 18:50:27.494056 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.494022 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.494056 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.494055 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-config-volume\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.494263 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.494072 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-tmp-dir\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.494263 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.494095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/364faadd-a345-4965-bef1-4b5e0bff06fd-cert\") pod \"ingress-canary-x7sql\" (UID: \"364faadd-a345-4965-bef1-4b5e0bff06fd\") " pod="openshift-ingress-canary/ingress-canary-x7sql" Jul 07 18:50:27.494263 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.494122 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f58q\" (UniqueName: \"kubernetes.io/projected/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-kube-api-access-2f58q\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.494263 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:27.494181 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:27.494263 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.494192 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566dw\" (UniqueName: \"kubernetes.io/projected/364faadd-a345-4965-bef1-4b5e0bff06fd-kube-api-access-566dw\") pod \"ingress-canary-x7sql\" (UID: \"364faadd-a345-4965-bef1-4b5e0bff06fd\") " pod="openshift-ingress-canary/ingress-canary-x7sql" Jul 07 18:50:27.494531 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:27.494285 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls podName:3ba14cc4-ebe4-40ca-83e1-b6d89506ce86 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:27.994245959 +0000 UTC m=+36.053693699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls") pod "dns-default-z5nhx" (UID: "3ba14cc4-ebe4-40ca-83e1-b6d89506ce86") : secret "dns-default-metrics-tls" not found Jul 07 18:50:27.494596 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.494505 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-tmp-dir\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.494815 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.494792 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-config-volume\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.499427 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.499408 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/364faadd-a345-4965-bef1-4b5e0bff06fd-cert\") pod \"ingress-canary-x7sql\" (UID: \"364faadd-a345-4965-bef1-4b5e0bff06fd\") " pod="openshift-ingress-canary/ingress-canary-x7sql" Jul 07 18:50:27.504999 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.504975 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-566dw\" (UniqueName: \"kubernetes.io/projected/364faadd-a345-4965-bef1-4b5e0bff06fd-kube-api-access-566dw\") pod \"ingress-canary-x7sql\" (UID: \"364faadd-a345-4965-bef1-4b5e0bff06fd\") " pod="openshift-ingress-canary/ingress-canary-x7sql" Jul 07 18:50:27.505199 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.505153 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f58q\" (UniqueName: \"kubernetes.io/projected/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-kube-api-access-2f58q\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.538043 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.538019 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7sql" Jul 07 18:50:27.680104 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.679829 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7sql"] Jul 07 18:50:27.684417 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:27.684388 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364faadd_a345_4965_bef1_4b5e0bff06fd.slice/crio-601e28771a086d8c83fdd67d6aaa7102c8f5681647140cc64d156c9ebb355df4 WatchSource:0}: Error finding container 601e28771a086d8c83fdd67d6aaa7102c8f5681647140cc64d156c9ebb355df4: Status 404 returned error can't find the container with id 601e28771a086d8c83fdd67d6aaa7102c8f5681647140cc64d156c9ebb355df4 Jul 07 18:50:27.999285 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:27.999208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:27.999446 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:27.999346 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:27.999446 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:27.999415 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls podName:3ba14cc4-ebe4-40ca-83e1-b6d89506ce86 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:28.999400383 +0000 UTC m=+37.058848113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls") pod "dns-default-z5nhx" (UID: "3ba14cc4-ebe4-40ca-83e1-b6d89506ce86") : secret "dns-default-metrics-tls" not found Jul 07 18:50:28.011865 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.011836 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:28.110716 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.110687 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:28.525958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.525743 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:28.526703 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.525998 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:28.526703 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.526459 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:28.528855 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.528832 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x88g7\"" Jul 07 18:50:28.529498 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.529478 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 18:50:28.529639 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.529567 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 18:50:28.529695 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.529672 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 18:50:28.529811 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.529478 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 18:50:28.529939 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.529920 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7mdbh\"" Jul 07 18:50:28.675280 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.675241 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7sql" event={"ID":"364faadd-a345-4965-bef1-4b5e0bff06fd","Type":"ContainerStarted","Data":"601e28771a086d8c83fdd67d6aaa7102c8f5681647140cc64d156c9ebb355df4"} Jul 07 18:50:28.965169 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:28.965133 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:29.006793 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:29.006762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:29.006951 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:29.006886 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:29.007016 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:29.006952 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls podName:3ba14cc4-ebe4-40ca-83e1-b6d89506ce86 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:31.006933353 +0000 UTC m=+39.066381084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls") pod "dns-default-z5nhx" (UID: "3ba14cc4-ebe4-40ca-83e1-b6d89506ce86") : secret "dns-default-metrics-tls" not found Jul 07 18:50:29.071834 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:29.071798 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:30.244393 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.244301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:30.312076 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.312044 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np"] Jul 07 18:50:30.312459 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.312433 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:30.314710 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.314685 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np" Jul 07 18:50:30.317117 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.317088 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:50:30.317244 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.317147 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 18:50:30.317244 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.317178 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6vlvf\"" Jul 07 18:50:30.327367 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.327322 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np"] Jul 07 18:50:30.417967 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.417919 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85gjc\" (UniqueName: \"kubernetes.io/projected/6ddc6e15-610a-43ef-bcbd-fc5b5401d876-kube-api-access-85gjc\") pod \"volume-data-source-validator-5d456fdbcd-m55np\" (UID: \"6ddc6e15-610a-43ef-bcbd-fc5b5401d876\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np" Jul 07 18:50:30.438329 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.438293 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv"] Jul 07 18:50:30.440764 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.440738 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-dcpp6"] Jul 07 18:50:30.440912 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.440872 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.442974 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.442953 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.444580 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.444559 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:50:30.445182 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.445164 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 18:50:30.445182 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.445174 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 18:50:30.445373 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.445334 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wn7p9\"" Jul 07 18:50:30.445550 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.445393 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 18:50:30.445676 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.445653 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:50:30.446041 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.446019 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 18:50:30.446457 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.446435 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 18:50:30.448487 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.448201 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 18:50:30.448487 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.448451 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9v5f6\"" Jul 07 18:50:30.459027 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.459005 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 18:50:30.474004 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.473982 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-dcpp6"] Jul 07 18:50:30.475742 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.475719 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv"] Jul 07 18:50:30.510979 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.510905 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:30.519270 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.519239 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85gjc\" (UniqueName: \"kubernetes.io/projected/6ddc6e15-610a-43ef-bcbd-fc5b5401d876-kube-api-access-85gjc\") pod \"volume-data-source-validator-5d456fdbcd-m55np\" (UID: \"6ddc6e15-610a-43ef-bcbd-fc5b5401d876\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np" Jul 07 18:50:30.537926 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.537899 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85gjc\" (UniqueName: \"kubernetes.io/projected/6ddc6e15-610a-43ef-bcbd-fc5b5401d876-kube-api-access-85gjc\") pod \"volume-data-source-validator-5d456fdbcd-m55np\" (UID: \"6ddc6e15-610a-43ef-bcbd-fc5b5401d876\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np" Jul 07 18:50:30.616223 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.616187 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:30.620026 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.619985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f1b3266-060f-4be8-a5f0-3f066792323e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zlwhv\" (UID: \"5f1b3266-060f-4be8-a5f0-3f066792323e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.620176 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.620035 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hx6r\" (UniqueName: \"kubernetes.io/projected/5f1b3266-060f-4be8-a5f0-3f066792323e-kube-api-access-6hx6r\") pod \"service-ca-operator-5d46d9ffd4-zlwhv\" (UID: \"5f1b3266-060f-4be8-a5f0-3f066792323e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.620176 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.620077 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1b3266-060f-4be8-a5f0-3f066792323e-config\") pod \"service-ca-operator-5d46d9ffd4-zlwhv\" (UID: \"5f1b3266-060f-4be8-a5f0-3f066792323e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.620176 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.620138 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb656ed5-7f35-4160-9464-cdefb2ea022d-trusted-ca\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.620334 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.620210 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb656ed5-7f35-4160-9464-cdefb2ea022d-config\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.620334 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.620248 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-427hq\" (UniqueName: \"kubernetes.io/projected/fb656ed5-7f35-4160-9464-cdefb2ea022d-kube-api-access-427hq\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.620334 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.620290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb656ed5-7f35-4160-9464-cdefb2ea022d-serving-cert\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.625565 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.625541 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np" Jul 07 18:50:30.631250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.631229 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-ccb877549-pms8p"] Jul 07 18:50:30.633051 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.633034 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.636083 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.636058 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 18:50:30.636083 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.636076 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 18:50:30.636828 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.636395 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 18:50:30.636828 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.636622 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 18:50:30.636828 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.636637 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 18:50:30.636828 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.636644 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 18:50:30.636828 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.636739 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zb9kg\"" Jul 07 18:50:30.650097 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.650076 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ccb877549-pms8p"] Jul 07 18:50:30.721237 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.721206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb656ed5-7f35-4160-9464-cdefb2ea022d-trusted-ca\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.721416 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.721275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb656ed5-7f35-4160-9464-cdefb2ea022d-config\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.721416 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.721304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-427hq\" (UniqueName: \"kubernetes.io/projected/fb656ed5-7f35-4160-9464-cdefb2ea022d-kube-api-access-427hq\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.721416 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.721329 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb656ed5-7f35-4160-9464-cdefb2ea022d-serving-cert\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.721416 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.721410 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f1b3266-060f-4be8-a5f0-3f066792323e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zlwhv\" (UID: \"5f1b3266-060f-4be8-a5f0-3f066792323e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.721633 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.721429 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hx6r\" (UniqueName: \"kubernetes.io/projected/5f1b3266-060f-4be8-a5f0-3f066792323e-kube-api-access-6hx6r\") pod \"service-ca-operator-5d46d9ffd4-zlwhv\" (UID: \"5f1b3266-060f-4be8-a5f0-3f066792323e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.721633 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.721465 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1b3266-060f-4be8-a5f0-3f066792323e-config\") pod \"service-ca-operator-5d46d9ffd4-zlwhv\" (UID: \"5f1b3266-060f-4be8-a5f0-3f066792323e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.722155 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.722129 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1b3266-060f-4be8-a5f0-3f066792323e-config\") pod \"service-ca-operator-5d46d9ffd4-zlwhv\" (UID: \"5f1b3266-060f-4be8-a5f0-3f066792323e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.722266 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.722134 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb656ed5-7f35-4160-9464-cdefb2ea022d-config\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.722266 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.722204 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb656ed5-7f35-4160-9464-cdefb2ea022d-trusted-ca\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.724286 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.724265 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f1b3266-060f-4be8-a5f0-3f066792323e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zlwhv\" (UID: \"5f1b3266-060f-4be8-a5f0-3f066792323e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.724425 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.724408 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb656ed5-7f35-4160-9464-cdefb2ea022d-serving-cert\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.731830 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.731809 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hx6r\" (UniqueName: \"kubernetes.io/projected/5f1b3266-060f-4be8-a5f0-3f066792323e-kube-api-access-6hx6r\") pod \"service-ca-operator-5d46d9ffd4-zlwhv\" (UID: \"5f1b3266-060f-4be8-a5f0-3f066792323e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.731946 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.731927 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-427hq\" (UniqueName: \"kubernetes.io/projected/fb656ed5-7f35-4160-9464-cdefb2ea022d-kube-api-access-427hq\") pod \"console-operator-68b757fb67-dcpp6\" (UID: \"fb656ed5-7f35-4160-9464-cdefb2ea022d\") " pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.752838 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.752820 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" Jul 07 18:50:30.759325 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.759308 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:30.822434 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.822401 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-stats-auth\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.822434 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.822435 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.822664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.822456 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-default-certificate\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.822664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.822473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62qwh\" (UniqueName: \"kubernetes.io/projected/b353dd5b-714f-4635-87b1-4577cdac4974-kube-api-access-62qwh\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.822664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.822603 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.845848 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.845812 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:30.923711 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.923671 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.923898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.923729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-stats-auth\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.923898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.923757 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.923898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.923782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-default-certificate\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.923898 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:30.923805 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:31.423785832 +0000 UTC m=+39.483233560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : configmap references non-existent config key: service-ca.crt Jul 07 18:50:30.923898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.923854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62qwh\" (UniqueName: \"kubernetes.io/projected/b353dd5b-714f-4635-87b1-4577cdac4974-kube-api-access-62qwh\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.923898 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:30.923889 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:50:30.924194 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:30.923973 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:31.423937527 +0000 UTC m=+39.483385257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : secret "router-metrics-certs-default" not found Jul 07 18:50:30.926644 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.926595 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-stats-auth\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.926644 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.926634 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-default-certificate\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.936018 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.935995 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62qwh\" (UniqueName: \"kubernetes.io/projected/b353dd5b-714f-4635-87b1-4577cdac4974-kube-api-access-62qwh\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:30.948077 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:30.948050 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:31.025208 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.025082 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:31.025385 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:31.025272 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:31.025385 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:31.025347 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls podName:3ba14cc4-ebe4-40ca-83e1-b6d89506ce86 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:35.025327787 +0000 UTC m=+43.084775519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls") pod "dns-default-z5nhx" (UID: "3ba14cc4-ebe4-40ca-83e1-b6d89506ce86") : secret "dns-default-metrics-tls" not found Jul 07 18:50:31.401047 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.400877 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-dcpp6"] Jul 07 18:50:31.406457 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.406421 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np"] Jul 07 18:50:31.412998 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.412971 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv"] Jul 07 18:50:31.418110 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:31.418072 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ddc6e15_610a_43ef_bcbd_fc5b5401d876.slice/crio-ab3fe822d58044a15b28199eacefd26002de83c9e7667ff5abe18d5f0e381db6 WatchSource:0}: Error finding container ab3fe822d58044a15b28199eacefd26002de83c9e7667ff5abe18d5f0e381db6: Status 404 returned error can't find the container with id ab3fe822d58044a15b28199eacefd26002de83c9e7667ff5abe18d5f0e381db6 Jul 07 18:50:31.419060 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:31.419034 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb656ed5_7f35_4160_9464_cdefb2ea022d.slice/crio-d4f33fce386e3fe71f0946d7c16bbf2a36b6a2a64674d61882f44da47b900b32 WatchSource:0}: Error finding container d4f33fce386e3fe71f0946d7c16bbf2a36b6a2a64674d61882f44da47b900b32: Status 404 returned error can't find the container with id d4f33fce386e3fe71f0946d7c16bbf2a36b6a2a64674d61882f44da47b900b32 Jul 07 18:50:31.420191 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:31.420160 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1b3266_060f_4be8_a5f0_3f066792323e.slice/crio-b05ba7e8310cbf23a2641fb1dd8e94672f0b7dd8c802355a72c47637c850a5a8 WatchSource:0}: Error finding container b05ba7e8310cbf23a2641fb1dd8e94672f0b7dd8c802355a72c47637c850a5a8: Status 404 returned error can't find the container with id b05ba7e8310cbf23a2641fb1dd8e94672f0b7dd8c802355a72c47637c850a5a8 Jul 07 18:50:31.429004 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.428982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:31.429085 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.429019 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:31.429120 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:31.429108 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:50:31.429153 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:31.429147 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:32.42913506 +0000 UTC m=+40.488582790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : secret "router-metrics-certs-default" not found Jul 07 18:50:31.429191 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:31.429160 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:32.429154046 +0000 UTC m=+40.488601775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : configmap references non-existent config key: service-ca.crt Jul 07 18:50:31.684335 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.684306 2582 generic.go:356] "Generic (PLEG): container finished" podID="a1e008c7-4494-4cb3-98d4-7ea7e742eb8f" containerID="bf6d5e93507f0bd5f92a2642eb783d0c12811a54d1e73f33c8f723dceb8ed576" exitCode=0 Jul 07 18:50:31.684514 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.684400 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" event={"ID":"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f","Type":"ContainerDied","Data":"bf6d5e93507f0bd5f92a2642eb783d0c12811a54d1e73f33c8f723dceb8ed576"} Jul 07 18:50:31.685519 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.685499 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np" event={"ID":"6ddc6e15-610a-43ef-bcbd-fc5b5401d876","Type":"ContainerStarted","Data":"ab3fe822d58044a15b28199eacefd26002de83c9e7667ff5abe18d5f0e381db6"} Jul 07 18:50:31.686635 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.686600 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" event={"ID":"fb656ed5-7f35-4160-9464-cdefb2ea022d","Type":"ContainerStarted","Data":"d4f33fce386e3fe71f0946d7c16bbf2a36b6a2a64674d61882f44da47b900b32"} Jul 07 18:50:31.687930 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.687908 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7sql" event={"ID":"364faadd-a345-4965-bef1-4b5e0bff06fd","Type":"ContainerStarted","Data":"67cd1b5dd315b992b85317d6f9f3b83be3dfda3d0a3ae3786e51d817e4661e61"} Jul 07 18:50:31.688958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.688937 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" event={"ID":"5f1b3266-060f-4be8-a5f0-3f066792323e","Type":"ContainerStarted","Data":"b05ba7e8310cbf23a2641fb1dd8e94672f0b7dd8c802355a72c47637c850a5a8"} Jul 07 18:50:31.754909 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:31.754834 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x7sql" podStartSLOduration=1.206467521 podStartE2EDuration="4.7548138s" totalImagesPullingTime="3.548346279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:31.754571807 +0000 UTC m=+39.814019559" watchObservedRunningTime="2026-07-07 18:50:31.7548138 +0000 UTC m=+39.814261557" Jul 07 18:50:32.436967 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:32.436927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:32.437772 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:32.436986 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:32.437772 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:32.437086 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:50:32.437772 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:32.437115 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:34.437091346 +0000 UTC m=+42.496539091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : configmap references non-existent config key: service-ca.crt Jul 07 18:50:32.437772 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:32.437144 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:34.43713297 +0000 UTC m=+42.496580701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : secret "router-metrics-certs-default" not found Jul 07 18:50:32.622109 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:32.622075 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:32.690117 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:32.690042 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:32.696916 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:32.696880 2582 generic.go:356] "Generic (PLEG): container finished" podID="a1e008c7-4494-4cb3-98d4-7ea7e742eb8f" containerID="20e700cbf171b83bc0f6790f862f094ae48f090ea16ebd979289def28b235d5c" exitCode=0 Jul 07 18:50:32.697556 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:32.697527 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" event={"ID":"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f","Type":"ContainerDied","Data":"20e700cbf171b83bc0f6790f862f094ae48f090ea16ebd979289def28b235d5c"} Jul 07 18:50:33.703522 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:33.703469 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" event={"ID":"a1e008c7-4494-4cb3-98d4-7ea7e742eb8f","Type":"ContainerStarted","Data":"43f19e6a00ba69d8a1f0ac20f5019652afadcc943be936920776dc415ec22caf"} Jul 07 18:50:33.705078 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:33.705045 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np" event={"ID":"6ddc6e15-610a-43ef-bcbd-fc5b5401d876","Type":"ContainerStarted","Data":"039d7d2654dab654ae91b5d92f7308e1b5a17ad8bb3b6ff08c9e73bd1b4ad76b"} Jul 07 18:50:33.732208 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:33.732145 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4wk8j" podStartSLOduration=7.739644553 podStartE2EDuration="40.732125134s" totalImagesPullingTime="32.992480581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:33.731668925 +0000 UTC m=+41.791116677" watchObservedRunningTime="2026-07-07 18:50:33.732125134 +0000 UTC m=+41.791572889" Jul 07 18:50:33.750979 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:33.750925 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-m55np" podStartSLOduration=2.095426235 podStartE2EDuration="3.750906811s" totalImagesPullingTime="1.655480576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:33.749947233 +0000 UTC m=+41.809394988" watchObservedRunningTime="2026-07-07 18:50:33.750906811 +0000 UTC m=+41.810354542" Jul 07 18:50:33.862674 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:33.862586 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:33.930737 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:33.930702 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:34.452932 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:34.452882 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:34.452932 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:34.452939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:34.453150 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:34.453049 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:38.45303003 +0000 UTC m=+46.512477764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : configmap references non-existent config key: service-ca.crt Jul 07 18:50:34.453150 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:34.453059 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:50:34.453150 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:34.453110 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:38.453098115 +0000 UTC m=+46.512545844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : secret "router-metrics-certs-default" not found Jul 07 18:50:35.058607 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.058579 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:35.058962 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:35.058710 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:35.058962 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:35.058796 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls podName:3ba14cc4-ebe4-40ca-83e1-b6d89506ce86 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:43.058771874 +0000 UTC m=+51.118219624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls") pod "dns-default-z5nhx" (UID: "3ba14cc4-ebe4-40ca-83e1-b6d89506ce86") : secret "dns-default-metrics-tls" not found Jul 07 18:50:35.705871 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.705838 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4l94p"] Jul 07 18:50:35.712930 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.712902 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/0.log" Jul 07 18:50:35.713051 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.712940 2582 generic.go:356] "Generic (PLEG): container finished" podID="fb656ed5-7f35-4160-9464-cdefb2ea022d" containerID="9fbd0ec29521d210c8b55a819e02c6d6cffa900a90f708ab8ead986867d291bb" exitCode=255 Jul 07 18:50:35.713173 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.713161 2582 scope.go:117] "RemoveContainer" containerID="9fbd0ec29521d210c8b55a819e02c6d6cffa900a90f708ab8ead986867d291bb" Jul 07 18:50:35.723118 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.723091 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" event={"ID":"5f1b3266-060f-4be8-a5f0-3f066792323e","Type":"ContainerStarted","Data":"14da552df7957b23ab1fe4f9e87a66199a26d160fc5da8aa7e2ac524a7c741e6"} Jul 07 18:50:35.723118 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.723120 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" event={"ID":"fb656ed5-7f35-4160-9464-cdefb2ea022d","Type":"ContainerDied","Data":"9fbd0ec29521d210c8b55a819e02c6d6cffa900a90f708ab8ead986867d291bb"} Jul 07 18:50:35.723243 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.723209 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.726664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.726164 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 18:50:35.726664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.726229 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 18:50:35.726664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.726247 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 18:50:35.726664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.726172 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ckhk8\"" Jul 07 18:50:35.726664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.726385 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 18:50:35.726664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.726538 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4l94p"] Jul 07 18:50:35.731784 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.730874 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:35.739153 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.739114 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" podStartSLOduration=2.299934324 podStartE2EDuration="5.739101097s" totalImagesPullingTime="3.439166773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:35.738009291 +0000 UTC m=+43.797457041" watchObservedRunningTime="2026-07-07 18:50:35.739101097 +0000 UTC m=+43.798548848" Jul 07 18:50:35.763558 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.763503 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27eb16aa-ceaa-403b-a255-bae1f23bf034-crio-socket\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.764265 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.763687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.764265 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.763715 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.764265 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.763780 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4xvm\" (UniqueName: \"kubernetes.io/projected/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-api-access-f4xvm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.764265 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.763808 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27eb16aa-ceaa-403b-a255-bae1f23bf034-data-volume\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.836743 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.836707 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:35.864802 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.864777 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.864902 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.864812 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.864902 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.864852 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4xvm\" (UniqueName: \"kubernetes.io/projected/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-api-access-f4xvm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.864902 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.864880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27eb16aa-ceaa-403b-a255-bae1f23bf034-data-volume\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.864902 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:35.864887 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:35.865091 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.864928 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27eb16aa-ceaa-403b-a255-bae1f23bf034-crio-socket\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.865091 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:35.864955 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:36.36493493 +0000 UTC m=+44.424382659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : configmap "kube-rbac-proxy" not found Jul 07 18:50:35.865091 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:35.864999 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:35.865091 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:35.865058 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:36.365041876 +0000 UTC m=+44.424489609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:35.865402 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.865115 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/27eb16aa-ceaa-403b-a255-bae1f23bf034-crio-socket\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.865402 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.865206 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/27eb16aa-ceaa-403b-a255-bae1f23bf034-data-volume\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:35.875640 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:35.875609 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4xvm\" (UniqueName: \"kubernetes.io/projected/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-api-access-f4xvm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:36.367618 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.367585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:36.367967 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.367621 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:36.367967 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:36.367695 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:36.367967 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:36.367714 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:36.367967 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:36.367754 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:37.367742786 +0000 UTC m=+45.427190516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:36.367967 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:36.367769 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:37.367762752 +0000 UTC m=+45.427210481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : configmap "kube-rbac-proxy" not found Jul 07 18:50:36.718061 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.717978 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 18:50:36.718764 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.718739 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/0.log" Jul 07 18:50:36.718894 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.718781 2582 generic.go:356] "Generic (PLEG): container finished" podID="fb656ed5-7f35-4160-9464-cdefb2ea022d" containerID="5bef0ed5f8aab4f878844ccbc033c711620d4dbec00ce03cd2cd6f4c1c87845a" exitCode=255 Jul 07 18:50:36.719590 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.719552 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" event={"ID":"fb656ed5-7f35-4160-9464-cdefb2ea022d","Type":"ContainerDied","Data":"5bef0ed5f8aab4f878844ccbc033c711620d4dbec00ce03cd2cd6f4c1c87845a"} Jul 07 18:50:36.719687 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.719652 2582 scope.go:117] "RemoveContainer" containerID="9fbd0ec29521d210c8b55a819e02c6d6cffa900a90f708ab8ead986867d291bb" Jul 07 18:50:36.720453 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.719962 2582 scope.go:117] "RemoveContainer" containerID="5bef0ed5f8aab4f878844ccbc033c711620d4dbec00ce03cd2cd6f4c1c87845a" Jul 07 18:50:36.720453 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:36.720171 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-dcpp6_openshift-console-operator(fb656ed5-7f35-4160-9464-cdefb2ea022d)\"" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" podUID="fb656ed5-7f35-4160-9464-cdefb2ea022d" Jul 07 18:50:36.806493 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.806449 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:36.908063 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.908030 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:36.999566 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:36.999491 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:37.361581 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:37.361547 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:37.377002 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:37.376975 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:37.377288 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:37.377008 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:37.377288 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:37.377094 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:37.377288 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:37.377141 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:37.377288 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:37.377152 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:39.377137381 +0000 UTC m=+47.436585111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : configmap "kube-rbac-proxy" not found Jul 07 18:50:37.377288 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:37.377177 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:39.377167111 +0000 UTC m=+47.436614860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:37.460586 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:37.460548 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:37.560200 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:37.560176 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-67wwj_dc56a815-1801-4e5a-8fe8-14079115aa5d/dns-node-resolver/0.log" Jul 07 18:50:37.645629 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:37.645556 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:37.722925 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:37.722901 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 18:50:37.723239 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:37.723224 2582 scope.go:117] "RemoveContainer" containerID="5bef0ed5f8aab4f878844ccbc033c711620d4dbec00ce03cd2cd6f4c1c87845a" Jul 07 18:50:37.723395 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:37.723376 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-dcpp6_openshift-console-operator(fb656ed5-7f35-4160-9464-cdefb2ea022d)\"" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" podUID="fb656ed5-7f35-4160-9464-cdefb2ea022d" Jul 07 18:50:37.743565 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:37.743535 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:38.484639 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:38.484604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:38.485079 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:38.484658 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:38.485079 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:38.484780 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:46.484762762 +0000 UTC m=+54.544210493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : configmap references non-existent config key: service-ca.crt Jul 07 18:50:38.485079 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:38.484790 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:50:38.485079 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:38.484830 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:46.484818609 +0000 UTC m=+54.544266337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : secret "router-metrics-certs-default" not found Jul 07 18:50:38.773192 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:38.773121 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lrgzk_a5f19387-4025-44c1-a4d8-8ccc995ebd45/node-ca/0.log" Jul 07 18:50:38.949811 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:38.949779 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:39.017653 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.017620 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:39.259600 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.259573 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dppkh"] Jul 07 18:50:39.283564 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.283541 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dppkh"] Jul 07 18:50:39.283692 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.283662 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.286150 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.286128 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 18:50:39.286250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.286184 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hfjhc\"" Jul 07 18:50:39.287075 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.287056 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 18:50:39.287180 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.287086 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 18:50:39.287180 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.287057 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 18:50:39.289329 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.289309 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aea1d823-3bdf-4308-8142-2ae03ff8f08f-signing-cabundle\") pod \"service-ca-758f599c5-dppkh\" (UID: \"aea1d823-3bdf-4308-8142-2ae03ff8f08f\") " pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.289416 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.289391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aea1d823-3bdf-4308-8142-2ae03ff8f08f-signing-key\") pod \"service-ca-758f599c5-dppkh\" (UID: \"aea1d823-3bdf-4308-8142-2ae03ff8f08f\") " pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.289462 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.289426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szlxs\" (UniqueName: \"kubernetes.io/projected/aea1d823-3bdf-4308-8142-2ae03ff8f08f-kube-api-access-szlxs\") pod \"service-ca-758f599c5-dppkh\" (UID: \"aea1d823-3bdf-4308-8142-2ae03ff8f08f\") " pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.300846 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.300823 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:39.390711 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.390681 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szlxs\" (UniqueName: \"kubernetes.io/projected/aea1d823-3bdf-4308-8142-2ae03ff8f08f-kube-api-access-szlxs\") pod \"service-ca-758f599c5-dppkh\" (UID: \"aea1d823-3bdf-4308-8142-2ae03ff8f08f\") " pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.390824 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.390735 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:39.390824 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.390762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:39.390824 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.390805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aea1d823-3bdf-4308-8142-2ae03ff8f08f-signing-cabundle\") pod \"service-ca-758f599c5-dppkh\" (UID: \"aea1d823-3bdf-4308-8142-2ae03ff8f08f\") " pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.390990 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:39.390825 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:39.390990 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.390878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aea1d823-3bdf-4308-8142-2ae03ff8f08f-signing-key\") pod \"service-ca-758f599c5-dppkh\" (UID: \"aea1d823-3bdf-4308-8142-2ae03ff8f08f\") " pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.390990 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:39.390907 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:39.390990 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:39.390917 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:43.39088016 +0000 UTC m=+51.450327904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : configmap "kube-rbac-proxy" not found Jul 07 18:50:39.390990 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:39.390975 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:43.390959909 +0000 UTC m=+51.450407654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:39.391503 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.391486 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aea1d823-3bdf-4308-8142-2ae03ff8f08f-signing-cabundle\") pod \"service-ca-758f599c5-dppkh\" (UID: \"aea1d823-3bdf-4308-8142-2ae03ff8f08f\") " pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.393348 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.393323 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aea1d823-3bdf-4308-8142-2ae03ff8f08f-signing-key\") pod \"service-ca-758f599c5-dppkh\" (UID: \"aea1d823-3bdf-4308-8142-2ae03ff8f08f\") " pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.415898 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.415870 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szlxs\" (UniqueName: \"kubernetes.io/projected/aea1d823-3bdf-4308-8142-2ae03ff8f08f-kube-api-access-szlxs\") pod \"service-ca-758f599c5-dppkh\" (UID: \"aea1d823-3bdf-4308-8142-2ae03ff8f08f\") " pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.592841 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.592758 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-dppkh" Jul 07 18:50:39.743039 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.743004 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-dppkh"] Jul 07 18:50:39.746153 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:39.746130 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea1d823_3bdf_4308_8142_2ae03ff8f08f.slice/crio-52289a14920a89fb03c596f259b4db5f5847780512edff0641777fcdb1801823 WatchSource:0}: Error finding container 52289a14920a89fb03c596f259b4db5f5847780512edff0641777fcdb1801823: Status 404 returned error can't find the container with id 52289a14920a89fb03c596f259b4db5f5847780512edff0641777fcdb1801823 Jul 07 18:50:39.762089 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:39.762066 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7sql_364faadd-a345-4965-bef1-4b5e0bff06fd/serve-healthcheck-canary/0.log" Jul 07 18:50:40.666178 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:40.666138 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:40.731322 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:40.731292 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dppkh" event={"ID":"aea1d823-3bdf-4308-8142-2ae03ff8f08f","Type":"ContainerStarted","Data":"0f3d9f7c374f0065c887ef89f14eb9f0567ab4a411547a7ff2ce092a303a1eae"} Jul 07 18:50:40.731475 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:40.731363 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-dppkh" event={"ID":"aea1d823-3bdf-4308-8142-2ae03ff8f08f","Type":"ContainerStarted","Data":"52289a14920a89fb03c596f259b4db5f5847780512edff0641777fcdb1801823"} Jul 07 18:50:40.753851 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:40.753800 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-dppkh" podStartSLOduration=1.753782815 podStartE2EDuration="1.753782815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:40.752857588 +0000 UTC m=+48.812305340" watchObservedRunningTime="2026-07-07 18:50:40.753782815 +0000 UTC m=+48.813230561" Jul 07 18:50:40.759941 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:40.759922 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:40.760008 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:40.759967 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:40.760313 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:40.760300 2582 scope.go:117] "RemoveContainer" containerID="5bef0ed5f8aab4f878844ccbc033c711620d4dbec00ce03cd2cd6f4c1c87845a" Jul 07 18:50:40.760508 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:40.760487 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-dcpp6_openshift-console-operator(fb656ed5-7f35-4160-9464-cdefb2ea022d)\"" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" podUID="fb656ed5-7f35-4160-9464-cdefb2ea022d" Jul 07 18:50:41.336018 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:41.335981 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:41.436946 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:41.436894 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:41.538627 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:41.538591 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:41.638787 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:41.638753 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:41.705332 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:41.705306 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:42.229577 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:42.229548 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:42.834737 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:42.834704 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:43.121598 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:43.121561 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:43.121789 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:43.121716 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:50:43.121789 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:43.121781 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls podName:3ba14cc4-ebe4-40ca-83e1-b6d89506ce86 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:59.121765093 +0000 UTC m=+67.181212821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls") pod "dns-default-z5nhx" (UID: "3ba14cc4-ebe4-40ca-83e1-b6d89506ce86") : secret "dns-default-metrics-tls" not found Jul 07 18:50:43.424083 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:43.424004 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:43.424083 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:43.424048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:43.424311 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:43.424113 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:50:43.424311 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:43.424172 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:51.424152706 +0000 UTC m=+59.483600435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : configmap "kube-rbac-proxy" not found Jul 07 18:50:43.424311 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:43.424227 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:50:43.424311 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:43.424299 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls podName:27eb16aa-ceaa-403b-a255-bae1f23bf034 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:51.424281951 +0000 UTC m=+59.483729696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4l94p" (UID: "27eb16aa-ceaa-403b-a255-bae1f23bf034") : secret "insights-runtime-extractor-tls" not found Jul 07 18:50:43.440340 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:43.440311 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:43.542609 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:43.542584 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:43.642774 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:43.642748 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:44.039512 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:44.039477 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:44.256888 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:44.256846 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:44.632303 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:44.632264 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:45.031574 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:45.031499 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:45.237718 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:45.237673 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:45.335750 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:45.335657 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:45.634754 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:45.634722 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:46.038713 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:46.038632 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:46.103771 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:46.103746 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:46.440748 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:46.440717 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:46.548716 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:46.548693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:46.548836 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:46.548754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:46.548876 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:50:46.548847 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle podName:b353dd5b-714f-4635-87b1-4577cdac4974 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:02.548826536 +0000 UTC m=+70.608274266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle") pod "router-default-ccb877549-pms8p" (UID: "b353dd5b-714f-4635-87b1-4577cdac4974") : configmap references non-existent config key: service-ca.crt Jul 07 18:50:46.550970 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:46.550954 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b353dd5b-714f-4635-87b1-4577cdac4974-metrics-certs\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:50:46.632462 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:46.632430 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:47.037559 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:47.037524 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:47.544567 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:47.544537 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:47.643982 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:47.643953 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:47.834183 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:47.834096 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:48.253178 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:48.253146 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:48.439439 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:48.439388 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:48.639515 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:48.639489 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:48.846981 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:48.846947 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:48.945613 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:48.945503 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:50.027414 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:50.027375 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:50.229375 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:50.229327 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:50.433273 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:50.433239 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:50.635613 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:50.635575 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:50.827788 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:50.827701 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:51.485650 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:51.485616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:51.485650 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:51.485650 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:51.486151 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:51.486124 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/27eb16aa-ceaa-403b-a255-bae1f23bf034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:51.487884 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:51.487855 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/27eb16aa-ceaa-403b-a255-bae1f23bf034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4l94p\" (UID: \"27eb16aa-ceaa-403b-a255-bae1f23bf034\") " pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:51.635366 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:51.635338 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4l94p" Jul 07 18:50:51.644739 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:51.644714 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:51.759831 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:51.759760 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4l94p"] Jul 07 18:50:51.763570 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:51.763545 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27eb16aa_ceaa_403b_a255_bae1f23bf034.slice/crio-ddaa4ae4102fc9e9ca5467a4101ff12d1ca1cba06e11fb4f2a7a125b6e56b075 WatchSource:0}: Error finding container ddaa4ae4102fc9e9ca5467a4101ff12d1ca1cba06e11fb4f2a7a125b6e56b075: Status 404 returned error can't find the container with id ddaa4ae4102fc9e9ca5467a4101ff12d1ca1cba06e11fb4f2a7a125b6e56b075 Jul 07 18:50:51.829659 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:51.829625 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:52.028634 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:52.028551 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:52.593719 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:52.593506 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:52.698013 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:52.697973 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:52.765024 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:52.764967 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4l94p" event={"ID":"27eb16aa-ceaa-403b-a255-bae1f23bf034","Type":"ContainerStarted","Data":"ddaa4ae4102fc9e9ca5467a4101ff12d1ca1cba06e11fb4f2a7a125b6e56b075"} Jul 07 18:50:54.526327 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:54.526291 2582 scope.go:117] "RemoveContainer" containerID="5bef0ed5f8aab4f878844ccbc033c711620d4dbec00ce03cd2cd6f4c1c87845a" Jul 07 18:50:54.669282 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:54.669250 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42hq2" Jul 07 18:50:55.776295 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:55.776212 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4l94p" event={"ID":"27eb16aa-ceaa-403b-a255-bae1f23bf034","Type":"ContainerStarted","Data":"3356d6f42eb3fb04e6c3e4730d005f7498e78058fb143c43c0fab3f0451293b6"} Jul 07 18:50:55.777999 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:55.777979 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 18:50:55.778132 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:55.778050 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" event={"ID":"fb656ed5-7f35-4160-9464-cdefb2ea022d","Type":"ContainerStarted","Data":"1f3a059abcba145586ac173ccc5328002b72c4db29f4184a03d74a02f8b4c50e"} Jul 07 18:50:55.778336 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:55.778316 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:55.796978 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:55.796930 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" podStartSLOduration=22.360868803 podStartE2EDuration="25.796913752s" totalImagesPullingTime="3.436044949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:55.796659225 +0000 UTC m=+63.856106975" watchObservedRunningTime="2026-07-07 18:50:55.796913752 +0000 UTC m=+63.856361505" Jul 07 18:50:56.413688 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:56.413618 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-dcpp6" Jul 07 18:50:56.607626 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:56.607590 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:56.713969 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:56.713855 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:56.783978 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:56.783934 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4l94p" event={"ID":"27eb16aa-ceaa-403b-a255-bae1f23bf034","Type":"ContainerStarted","Data":"d9e0357d0458e082411ae26edbc026afbdf168b72774660afc7eeac437568a60"} Jul 07 18:50:56.895828 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:56.895786 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:57.276439 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:57.276406 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:57.334707 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:57.334667 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:57.676391 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:57.676342 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:57.745386 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:57.745335 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:58.115213 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.115173 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:58.214368 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.214317 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:58.243506 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.243473 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:58.243678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.243627 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:58.245794 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.245773 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 18:50:58.246590 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.246574 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 18:50:58.256497 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.256475 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6ab5966-dc6c-45e1-8a34-fa10502ebb56-original-pull-secret\") pod \"global-pull-secret-syncer-rxrn4\" (UID: \"a6ab5966-dc6c-45e1-8a34-fa10502ebb56\") " pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:58.256882 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.256859 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4444bb12-3fdf-44c0-a2ff-fa21ff8556be-metrics-certs\") pod \"network-metrics-daemon-bpz5n\" (UID: \"4444bb12-3fdf-44c0-a2ff-fa21ff8556be\") " pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:58.317925 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.317889 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:58.344907 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.344877 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:58.347371 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.347341 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 18:50:58.357791 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.357771 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 18:50:58.369267 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.369189 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wczlw\" (UniqueName: \"kubernetes.io/projected/f37af844-2b8c-4e3c-8349-4eb2ca35d999-kube-api-access-wczlw\") pod \"network-check-target-t59k8\" (UID: \"f37af844-2b8c-4e3c-8349-4eb2ca35d999\") " pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:58.509111 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.509024 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf"] Jul 07 18:50:58.520154 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.520130 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" Jul 07 18:50:58.525540 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.525512 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 18:50:58.525685 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.525544 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 18:50:58.525685 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.525591 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gwk7j\"" Jul 07 18:50:58.525942 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.525925 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 18:50:58.530610 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.530589 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 18:50:58.531302 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.531283 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf"] Jul 07 18:50:58.538183 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.538163 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rxrn4" Jul 07 18:50:58.550846 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.550830 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x88g7\"" Jul 07 18:50:58.555042 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.555022 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7mdbh\"" Jul 07 18:50:58.556694 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.556674 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpz5n" Jul 07 18:50:58.563290 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.563272 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:50:58.579883 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.579851 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:58.585967 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.585943 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-hgmd9"] Jul 07 18:50:58.589711 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.589617 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-hgmd9" Jul 07 18:50:58.592194 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.592150 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d97f7f679-bwklk"] Jul 07 18:50:58.593860 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.593431 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 18:50:58.593860 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.593607 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 18:50:58.593860 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.593697 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v278g\"" Jul 07 18:50:58.594642 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.594462 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.597839 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.597813 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 18:50:58.598086 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.598070 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 18:50:58.598308 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.598294 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4c4xx\"" Jul 07 18:50:58.598986 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.598957 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 18:50:58.610614 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.610497 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 18:50:58.610846 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.610771 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-hgmd9"] Jul 07 18:50:58.625442 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.625420 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d97f7f679-bwklk"] Jul 07 18:50:58.647515 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647263 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f27c9c43-832e-4a31-9cd4-1d5195960c06-ca-trust-extracted\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.647515 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647298 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f27c9c43-832e-4a31-9cd4-1d5195960c06-registry-certificates\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.647515 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647338 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwh2n\" (UniqueName: \"kubernetes.io/projected/50e5cae2-5fbe-4e24-b94d-d922317bafd7-kube-api-access-wwh2n\") pod \"downloads-685bfb5f64-hgmd9\" (UID: \"50e5cae2-5fbe-4e24-b94d-d922317bafd7\") " pod="openshift-console/downloads-685bfb5f64-hgmd9" Jul 07 18:50:58.647515 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647386 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cdd825e9-d52f-4fb6-a66e-fbca947861cb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf\" (UID: \"cdd825e9-d52f-4fb6-a66e-fbca947861cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" Jul 07 18:50:58.647515 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dnk9\" (UniqueName: \"kubernetes.io/projected/cdd825e9-d52f-4fb6-a66e-fbca947861cb-kube-api-access-4dnk9\") pod \"managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf\" (UID: \"cdd825e9-d52f-4fb6-a66e-fbca947861cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" Jul 07 18:50:58.647515 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647488 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f27c9c43-832e-4a31-9cd4-1d5195960c06-image-registry-private-configuration\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.647877 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647518 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f27c9c43-832e-4a31-9cd4-1d5195960c06-trusted-ca\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.647877 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647555 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f27c9c43-832e-4a31-9cd4-1d5195960c06-registry-tls\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.647877 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647645 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4m6x\" (UniqueName: \"kubernetes.io/projected/f27c9c43-832e-4a31-9cd4-1d5195960c06-kube-api-access-w4m6x\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.647877 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647683 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f27c9c43-832e-4a31-9cd4-1d5195960c06-installation-pull-secrets\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.647877 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.647725 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f27c9c43-832e-4a31-9cd4-1d5195960c06-bound-sa-token\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.697740 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.697698 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:58.734779 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.734752 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rxrn4"] Jul 07 18:50:58.737783 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:58.737756 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ab5966_dc6c_45e1_8a34_fa10502ebb56.slice/crio-c3a4e46a50fcd64fcce27ccb61ab84bef115778372f0fa4830639dcd429f38b0 WatchSource:0}: Error finding container c3a4e46a50fcd64fcce27ccb61ab84bef115778372f0fa4830639dcd429f38b0: Status 404 returned error can't find the container with id c3a4e46a50fcd64fcce27ccb61ab84bef115778372f0fa4830639dcd429f38b0 Jul 07 18:50:58.748560 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f27c9c43-832e-4a31-9cd4-1d5195960c06-image-registry-private-configuration\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.748651 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748570 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f27c9c43-832e-4a31-9cd4-1d5195960c06-trusted-ca\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.748651 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748596 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f27c9c43-832e-4a31-9cd4-1d5195960c06-registry-tls\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.748720 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748682 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4m6x\" (UniqueName: \"kubernetes.io/projected/f27c9c43-832e-4a31-9cd4-1d5195960c06-kube-api-access-w4m6x\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.748720 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f27c9c43-832e-4a31-9cd4-1d5195960c06-installation-pull-secrets\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.748793 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748742 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f27c9c43-832e-4a31-9cd4-1d5195960c06-bound-sa-token\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.748793 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748776 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f27c9c43-832e-4a31-9cd4-1d5195960c06-ca-trust-extracted\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.748897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748800 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f27c9c43-832e-4a31-9cd4-1d5195960c06-registry-certificates\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.748897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748831 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh2n\" (UniqueName: \"kubernetes.io/projected/50e5cae2-5fbe-4e24-b94d-d922317bafd7-kube-api-access-wwh2n\") pod \"downloads-685bfb5f64-hgmd9\" (UID: \"50e5cae2-5fbe-4e24-b94d-d922317bafd7\") " pod="openshift-console/downloads-685bfb5f64-hgmd9" Jul 07 18:50:58.748897 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748859 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cdd825e9-d52f-4fb6-a66e-fbca947861cb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf\" (UID: \"cdd825e9-d52f-4fb6-a66e-fbca947861cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" Jul 07 18:50:58.749035 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.748905 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dnk9\" (UniqueName: \"kubernetes.io/projected/cdd825e9-d52f-4fb6-a66e-fbca947861cb-kube-api-access-4dnk9\") pod \"managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf\" (UID: \"cdd825e9-d52f-4fb6-a66e-fbca947861cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" Jul 07 18:50:58.749225 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.749205 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f27c9c43-832e-4a31-9cd4-1d5195960c06-ca-trust-extracted\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.749810 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.749786 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f27c9c43-832e-4a31-9cd4-1d5195960c06-trusted-ca\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.749810 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.749796 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f27c9c43-832e-4a31-9cd4-1d5195960c06-registry-certificates\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.751678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.751563 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f27c9c43-832e-4a31-9cd4-1d5195960c06-registry-tls\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.751777 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.751757 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f27c9c43-832e-4a31-9cd4-1d5195960c06-image-registry-private-configuration\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.751840 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.751805 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cdd825e9-d52f-4fb6-a66e-fbca947861cb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf\" (UID: \"cdd825e9-d52f-4fb6-a66e-fbca947861cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" Jul 07 18:50:58.751918 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.751892 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f27c9c43-832e-4a31-9cd4-1d5195960c06-installation-pull-secrets\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.752551 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.752530 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bpz5n"] Jul 07 18:50:58.755322 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:58.755302 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4444bb12_3fdf_44c0_a2ff_fa21ff8556be.slice/crio-07ec5c376bece367591f4072dc56670198145fc77debb3f239bb55330e93f205 WatchSource:0}: Error finding container 07ec5c376bece367591f4072dc56670198145fc77debb3f239bb55330e93f205: Status 404 returned error can't find the container with id 07ec5c376bece367591f4072dc56670198145fc77debb3f239bb55330e93f205 Jul 07 18:50:58.779315 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.779288 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t59k8"] Jul 07 18:50:58.780881 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.780860 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4m6x\" (UniqueName: \"kubernetes.io/projected/f27c9c43-832e-4a31-9cd4-1d5195960c06-kube-api-access-w4m6x\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.781198 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.781174 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f27c9c43-832e-4a31-9cd4-1d5195960c06-bound-sa-token\") pod \"image-registry-6d97f7f679-bwklk\" (UID: \"f27c9c43-832e-4a31-9cd4-1d5195960c06\") " pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.781316 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.781264 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwh2n\" (UniqueName: \"kubernetes.io/projected/50e5cae2-5fbe-4e24-b94d-d922317bafd7-kube-api-access-wwh2n\") pod \"downloads-685bfb5f64-hgmd9\" (UID: \"50e5cae2-5fbe-4e24-b94d-d922317bafd7\") " pod="openshift-console/downloads-685bfb5f64-hgmd9" Jul 07 18:50:58.781403 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.781340 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dnk9\" (UniqueName: \"kubernetes.io/projected/cdd825e9-d52f-4fb6-a66e-fbca947861cb-kube-api-access-4dnk9\") pod \"managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf\" (UID: \"cdd825e9-d52f-4fb6-a66e-fbca947861cb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" Jul 07 18:50:58.781935 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:58.781912 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37af844_2b8c_4e3c_8349_4eb2ca35d999.slice/crio-8f936603cc659cbdb164029b73c1c93eeb067a8512fbb682e97fe0c08b4b175e WatchSource:0}: Error finding container 8f936603cc659cbdb164029b73c1c93eeb067a8512fbb682e97fe0c08b4b175e: Status 404 returned error can't find the container with id 8f936603cc659cbdb164029b73c1c93eeb067a8512fbb682e97fe0c08b4b175e Jul 07 18:50:58.790739 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.790709 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpz5n" event={"ID":"4444bb12-3fdf-44c0-a2ff-fa21ff8556be","Type":"ContainerStarted","Data":"07ec5c376bece367591f4072dc56670198145fc77debb3f239bb55330e93f205"} Jul 07 18:50:58.791773 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.791747 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxrn4" event={"ID":"a6ab5966-dc6c-45e1-8a34-fa10502ebb56","Type":"ContainerStarted","Data":"c3a4e46a50fcd64fcce27ccb61ab84bef115778372f0fa4830639dcd429f38b0"} Jul 07 18:50:58.792680 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.792662 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t59k8" event={"ID":"f37af844-2b8c-4e3c-8349-4eb2ca35d999","Type":"ContainerStarted","Data":"8f936603cc659cbdb164029b73c1c93eeb067a8512fbb682e97fe0c08b4b175e"} Jul 07 18:50:58.794414 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.794394 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4l94p" event={"ID":"27eb16aa-ceaa-403b-a255-bae1f23bf034","Type":"ContainerStarted","Data":"6ae7fe0d6d1c8b70d21c3f4c2a3200a7ca86ee372c6d0640cb4f55215ba8a5f3"} Jul 07 18:50:58.799903 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.799882 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:58.819867 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.819832 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4l94p" podStartSLOduration=17.114588657 podStartE2EDuration="23.819819458s" totalImagesPullingTime="6.705230801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:58.819497698 +0000 UTC m=+66.878945451" watchObservedRunningTime="2026-07-07 18:50:58.819819458 +0000 UTC m=+66.879267208" Jul 07 18:50:58.836575 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.836558 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" Jul 07 18:50:58.900942 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.900915 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:50:58.926566 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.926539 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-hgmd9" Jul 07 18:50:58.947573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.947553 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:58.962619 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:58.962597 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf"] Jul 07 18:50:58.965650 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:58.965624 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdd825e9_d52f_4fb6_a66e_fbca947861cb.slice/crio-3a1c4ab52156f9603d08469c4b837bdb33ae75d09bdd42f421b1968d856b785c WatchSource:0}: Error finding container 3a1c4ab52156f9603d08469c4b837bdb33ae75d09bdd42f421b1968d856b785c: Status 404 returned error can't find the container with id 3a1c4ab52156f9603d08469c4b837bdb33ae75d09bdd42f421b1968d856b785c Jul 07 18:50:59.072569 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.072544 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-hgmd9"] Jul 07 18:50:59.074542 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:59.074516 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e5cae2_5fbe_4e24_b94d_d922317bafd7.slice/crio-63aceedbe326eda316d30c1c1a13e8dbeb40c827968cb9612bb984cf0776dec6 WatchSource:0}: Error finding container 63aceedbe326eda316d30c1c1a13e8dbeb40c827968cb9612bb984cf0776dec6: Status 404 returned error can't find the container with id 63aceedbe326eda316d30c1c1a13e8dbeb40c827968cb9612bb984cf0776dec6 Jul 07 18:50:59.127805 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.127785 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d97f7f679-bwklk"] Jul 07 18:50:59.130411 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:59.130387 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27c9c43_832e_4a31_9cd4_1d5195960c06.slice/crio-57e2fdaddca189dba3eaecf26ff87a1c2a257b1fc7024f388ed2cc4a6fabcd1a WatchSource:0}: Error finding container 57e2fdaddca189dba3eaecf26ff87a1c2a257b1fc7024f388ed2cc4a6fabcd1a: Status 404 returned error can't find the container with id 57e2fdaddca189dba3eaecf26ff87a1c2a257b1fc7024f388ed2cc4a6fabcd1a Jul 07 18:50:59.152815 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.152795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:59.154793 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.154770 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba14cc4-ebe4-40ca-83e1-b6d89506ce86-metrics-tls\") pod \"dns-default-z5nhx\" (UID: \"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86\") " pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:59.333091 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.332995 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-krxdw\"" Jul 07 18:50:59.340961 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.340925 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5nhx" Jul 07 18:50:59.547907 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.547824 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z5nhx"] Jul 07 18:50:59.555310 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:50:59.552312 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba14cc4_ebe4_40ca_83e1_b6d89506ce86.slice/crio-0b1e29c8ef7c5a26dbd680b9dc3c962e5bb2b5ab3fd55c12bc183337f8473f5d WatchSource:0}: Error finding container 0b1e29c8ef7c5a26dbd680b9dc3c962e5bb2b5ab3fd55c12bc183337f8473f5d: Status 404 returned error can't find the container with id 0b1e29c8ef7c5a26dbd680b9dc3c962e5bb2b5ab3fd55c12bc183337f8473f5d Jul 07 18:50:59.804993 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.804843 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" event={"ID":"f27c9c43-832e-4a31-9cd4-1d5195960c06","Type":"ContainerStarted","Data":"f5747c80b206736b7357bf587eeac4d1f71ecfa28e43c107be38f0816fdec440"} Jul 07 18:50:59.804993 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.804908 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" event={"ID":"f27c9c43-832e-4a31-9cd4-1d5195960c06","Type":"ContainerStarted","Data":"57e2fdaddca189dba3eaecf26ff87a1c2a257b1fc7024f388ed2cc4a6fabcd1a"} Jul 07 18:50:59.804993 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.804952 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:50:59.806983 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.806918 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5nhx" event={"ID":"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86","Type":"ContainerStarted","Data":"0b1e29c8ef7c5a26dbd680b9dc3c962e5bb2b5ab3fd55c12bc183337f8473f5d"} Jul 07 18:50:59.809965 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.809927 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-hgmd9" event={"ID":"50e5cae2-5fbe-4e24-b94d-d922317bafd7","Type":"ContainerStarted","Data":"63aceedbe326eda316d30c1c1a13e8dbeb40c827968cb9612bb984cf0776dec6"} Jul 07 18:50:59.812917 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.812859 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" event={"ID":"cdd825e9-d52f-4fb6-a66e-fbca947861cb","Type":"ContainerStarted","Data":"3a1c4ab52156f9603d08469c4b837bdb33ae75d09bdd42f421b1968d856b785c"} Jul 07 18:50:59.826120 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.825925 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" podStartSLOduration=1.825907993 podStartE2EDuration="1.825907993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:59.824573399 +0000 UTC m=+67.884021153" watchObservedRunningTime="2026-07-07 18:50:59.825907993 +0000 UTC m=+67.885355746" Jul 07 18:50:59.913166 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:50:59.913122 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:00.014735 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:00.014678 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:00.820917 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:00.820271 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpz5n" event={"ID":"4444bb12-3fdf-44c0-a2ff-fa21ff8556be","Type":"ContainerStarted","Data":"78adc7c6ff1df9bf1104b8ea6c148c1bdae4a14dc4efbfdcbfd27ed833b2adbc"} Jul 07 18:51:00.820917 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:00.820322 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpz5n" event={"ID":"4444bb12-3fdf-44c0-a2ff-fa21ff8556be","Type":"ContainerStarted","Data":"838a61d0c5d432a072cf71e7ca484ea0491549dfe03dac159ae8eaf03d75561b"} Jul 07 18:51:00.840955 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:00.840102 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bpz5n" podStartSLOduration=66.423956523 podStartE2EDuration="1m7.840081222s" totalImagesPullingTime="1.416124699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:00.838684919 +0000 UTC m=+68.898132672" watchObservedRunningTime="2026-07-07 18:51:00.840081222 +0000 UTC m=+68.899528974" Jul 07 18:51:00.942674 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:00.942528 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:01.010087 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:01.010000 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:02.584406 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:02.584349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:51:02.585071 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:02.585049 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b353dd5b-714f-4635-87b1-4577cdac4974-service-ca-bundle\") pod \"router-default-ccb877549-pms8p\" (UID: \"b353dd5b-714f-4635-87b1-4577cdac4974\") " pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:51:02.747805 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:02.747774 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zb9kg\"" Jul 07 18:51:02.755892 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:02.755862 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:51:06.469442 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.468195 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ccb877549-pms8p"] Jul 07 18:51:06.473823 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:51:06.473794 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb353dd5b_714f_4635_87b1_4577cdac4974.slice/crio-7478d3ce99e5a199a70b44eca57d899a2801bc7bed15c3c207fdcacee33b5bc0 WatchSource:0}: Error finding container 7478d3ce99e5a199a70b44eca57d899a2801bc7bed15c3c207fdcacee33b5bc0: Status 404 returned error can't find the container with id 7478d3ce99e5a199a70b44eca57d899a2801bc7bed15c3c207fdcacee33b5bc0 Jul 07 18:51:06.845485 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.845452 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t59k8" event={"ID":"f37af844-2b8c-4e3c-8349-4eb2ca35d999","Type":"ContainerStarted","Data":"06f1d56a21f9eb4d7434ff9b5a98d2313203cad0cf14b193ba7116d1864080ab"} Jul 07 18:51:06.845644 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.845569 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:51:06.846988 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.846959 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ccb877549-pms8p" event={"ID":"b353dd5b-714f-4635-87b1-4577cdac4974","Type":"ContainerStarted","Data":"86edcc4378ded4eb657e2670455aca2fc11de827c89d1424d0a1a22ea760601c"} Jul 07 18:51:06.847111 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.846999 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ccb877549-pms8p" event={"ID":"b353dd5b-714f-4635-87b1-4577cdac4974","Type":"ContainerStarted","Data":"7478d3ce99e5a199a70b44eca57d899a2801bc7bed15c3c207fdcacee33b5bc0"} Jul 07 18:51:06.848714 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.848694 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5nhx" event={"ID":"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86","Type":"ContainerStarted","Data":"c155d366ec2b150ba2fa360ca95784e9dfed5181006b27907a34b1ad89a7c5a9"} Jul 07 18:51:06.848832 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.848729 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5nhx" event={"ID":"3ba14cc4-ebe4-40ca-83e1-b6d89506ce86","Type":"ContainerStarted","Data":"fa57439a44b7f61f3be33df69efdee499c964c6e64b1fbc706732724e26bcb5c"} Jul 07 18:51:06.848832 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.848750 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z5nhx" Jul 07 18:51:06.850032 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.850016 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rxrn4" event={"ID":"a6ab5966-dc6c-45e1-8a34-fa10502ebb56","Type":"ContainerStarted","Data":"818bee148eecfc562e4b596dc1fce4af206e267df9a8a42214640bd47394f0d0"} Jul 07 18:51:06.851974 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.851954 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" event={"ID":"cdd825e9-d52f-4fb6-a66e-fbca947861cb","Type":"ContainerStarted","Data":"129bd5db56d5ef115298291e077527e5e5966b670464ffb6be567aada147f68f"} Jul 07 18:51:06.864519 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.864204 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t59k8" podStartSLOduration=66.337170919 podStartE2EDuration="1m13.864188417s" totalImagesPullingTime="7.527017498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:06.863791792 +0000 UTC m=+74.923239543" watchObservedRunningTime="2026-07-07 18:51:06.864188417 +0000 UTC m=+74.923636168" Jul 07 18:51:06.888615 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.888578 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z5nhx" podStartSLOduration=33.133115876 podStartE2EDuration="39.888566359s" totalImagesPullingTime="6.755450483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:06.887823084 +0000 UTC m=+74.947270833" watchObservedRunningTime="2026-07-07 18:51:06.888566359 +0000 UTC m=+74.948014110" Jul 07 18:51:06.916024 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.915988 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-ccb877549-pms8p" podStartSLOduration=36.915977244 podStartE2EDuration="36.915977244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:06.915342057 +0000 UTC m=+74.974789810" watchObservedRunningTime="2026-07-07 18:51:06.915977244 +0000 UTC m=+74.975424995" Jul 07 18:51:06.932664 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.932625 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rxrn4" podStartSLOduration=66.35162863 podStartE2EDuration="1m13.932602718s" totalImagesPullingTime="7.580974088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:06.931158246 +0000 UTC m=+74.990605997" watchObservedRunningTime="2026-07-07 18:51:06.932602718 +0000 UTC m=+74.992050470" Jul 07 18:51:06.952368 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:06.952319 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9b8b4f6b4-tjwzf" podStartSLOduration=1.610197298 podStartE2EDuration="8.952311129s" totalImagesPullingTime="7.342113831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:06.951497854 +0000 UTC m=+75.010945605" watchObservedRunningTime="2026-07-07 18:51:06.952311129 +0000 UTC m=+75.011758883" Jul 07 18:51:07.181125 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:07.181024 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:07.278471 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:07.278434 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:07.401307 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:07.401235 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:07.756609 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:07.756575 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:51:07.759619 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:07.759595 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:51:07.855320 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:07.855290 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:51:07.856507 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:07.856488 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-ccb877549-pms8p" Jul 07 18:51:08.541197 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:08.541147 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:11.428900 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:11.428866 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:11.507188 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:11.507151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:12.290552 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:12.290492 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:13.318615 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:13.318577 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:15.117002 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:15.116865 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:15.217630 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:15.217594 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:15.703794 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:15.703743 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:16.714828 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:16.714798 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:16.857263 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:16.857233 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z5nhx" Jul 07 18:51:17.522558 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.522526 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fcfb874d8-ktspl"] Jul 07 18:51:17.526533 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.526505 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.530010 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.529890 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 18:51:17.530010 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.529944 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zh69j\"" Jul 07 18:51:17.530569 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.530186 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 18:51:17.530569 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.530207 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 18:51:17.530569 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.530432 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 18:51:17.531310 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.531052 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 18:51:17.535244 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.535224 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 18:51:17.553231 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.553193 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fcfb874d8-ktspl"] Jul 07 18:51:17.608616 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.608567 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:17.705568 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.705532 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:17.705738 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.705698 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-trusted-ca-bundle\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.705807 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.705745 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzp5x\" (UniqueName: \"kubernetes.io/projected/a174a375-c80c-492d-bea8-08f0f3c1e2d0-kube-api-access-bzp5x\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.705807 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.705776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-oauth-config\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.705903 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.705818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-oauth-serving-cert\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.705903 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.705853 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-config\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.705995 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.705900 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-serving-cert\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.705995 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.705935 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-service-ca\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.807415 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.807323 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-trusted-ca-bundle\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.807415 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.807402 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzp5x\" (UniqueName: \"kubernetes.io/projected/a174a375-c80c-492d-bea8-08f0f3c1e2d0-kube-api-access-bzp5x\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.807894 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.807428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-oauth-config\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.807894 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.807478 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-oauth-serving-cert\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.807894 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.807526 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-config\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.807894 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.807553 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-serving-cert\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.807894 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.807567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-service-ca\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.808541 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.808270 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-service-ca\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.812045 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.812006 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-oauth-serving-cert\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.817382 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.816733 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-config\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.817382 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.816954 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-serving-cert\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.818075 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.818032 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-oauth-config\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.818625 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.818579 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-trusted-ca-bundle\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.828653 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.828630 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzp5x\" (UniqueName: \"kubernetes.io/projected/a174a375-c80c-492d-bea8-08f0f3c1e2d0-kube-api-access-bzp5x\") pod \"console-5fcfb874d8-ktspl\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.841342 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.841313 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:17.848682 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.848649 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:17.938194 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.938166 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f4pjg"] Jul 07 18:51:17.940310 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.940291 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:17.943397 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.943375 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 18:51:17.943397 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.943392 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 18:51:17.943793 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.943774 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fqp2b\"" Jul 07 18:51:17.943951 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.943884 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 18:51:17.944519 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.944451 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 18:51:17.944519 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.944506 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 18:51:17.944661 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.944550 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 18:51:17.947430 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:17.947391 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:18.030399 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.030369 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:18.110348 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.110320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.110524 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.110379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-tls\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.110524 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.110435 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5krz\" (UniqueName: \"kubernetes.io/projected/b3d59249-fe5a-4676-a015-34c406eb4544-kube-api-access-s5krz\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.110524 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.110471 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3d59249-fe5a-4676-a015-34c406eb4544-metrics-client-ca\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.110687 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.110540 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-textfile\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.110687 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.110560 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-accelerators-collector-config\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.110687 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.110619 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3d59249-fe5a-4676-a015-34c406eb4544-root\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.110687 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.110670 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3d59249-fe5a-4676-a015-34c406eb4544-sys\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.110861 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.110698 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-wtmp\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.137663 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.137617 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:18.211622 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.211594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3d59249-fe5a-4676-a015-34c406eb4544-sys\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.211797 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.211631 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-wtmp\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.211797 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.211662 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.211797 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.211678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-tls\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.211797 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.211680 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3d59249-fe5a-4676-a015-34c406eb4544-sys\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.211797 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.211703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5krz\" (UniqueName: \"kubernetes.io/projected/b3d59249-fe5a-4676-a015-34c406eb4544-kube-api-access-s5krz\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.211797 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:51:18.211795 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 18:51:18.212111 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.211822 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3d59249-fe5a-4676-a015-34c406eb4544-metrics-client-ca\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.212111 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.211846 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-wtmp\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.212111 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:51:18.211868 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-tls podName:b3d59249-fe5a-4676-a015-34c406eb4544 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:18.711847153 +0000 UTC m=+86.771294883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-tls") pod "node-exporter-f4pjg" (UID: "b3d59249-fe5a-4676-a015-34c406eb4544") : secret "node-exporter-tls" not found Jul 07 18:51:18.212111 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.212004 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-textfile\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.212111 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.212030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-accelerators-collector-config\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.212111 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.212061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3d59249-fe5a-4676-a015-34c406eb4544-root\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.212439 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.212139 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3d59249-fe5a-4676-a015-34c406eb4544-root\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.212439 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.212328 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-textfile\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.212539 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.212457 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3d59249-fe5a-4676-a015-34c406eb4544-metrics-client-ca\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.212792 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.212772 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-accelerators-collector-config\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.214527 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.214492 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.224636 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.223928 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5krz\" (UniqueName: \"kubernetes.io/projected/b3d59249-fe5a-4676-a015-34c406eb4544-kube-api-access-s5krz\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.236996 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.236898 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:18.341788 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.341692 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:18.419334 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.419256 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:18.494748 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.494707 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:18.683473 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.683375 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:18.717298 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.717270 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-tls\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.719776 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.719753 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3d59249-fe5a-4676-a015-34c406eb4544-node-exporter-tls\") pod \"node-exporter-f4pjg\" (UID: \"b3d59249-fe5a-4676-a015-34c406eb4544\") " pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.852433 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.852404 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f4pjg" Jul 07 18:51:18.893723 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.893691 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:18.953831 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.953732 2582 patch_prober.go:28] interesting pod/image-registry-6d97f7f679-bwklk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 18:51:18.953831 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:18.953791 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" podUID="f27c9c43-832e-4a31-9cd4-1d5195960c06" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 18:51:19.029711 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.029682 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:19.054462 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.054432 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:51:19.059946 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.058043 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.061064 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.060843 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 18:51:19.061064 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.060854 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 18:51:19.061064 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.060851 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lj7zx\"" Jul 07 18:51:19.061303 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.061142 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 18:51:19.061303 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.061199 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 18:51:19.061446 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.061312 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 18:51:19.061856 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.061840 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 18:51:19.062108 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.062089 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 18:51:19.062294 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.062278 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 18:51:19.062485 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.062467 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 18:51:19.075568 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.075546 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:51:19.221465 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221385 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221465 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221422 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221465 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221444 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221712 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221503 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221712 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221712 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-out\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221712 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221654 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221712 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221710 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221908 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221741 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221908 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221769 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221908 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221791 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2wmg\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-kube-api-access-c2wmg\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221908 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-web-config\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.221908 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.221867 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.241937 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.241903 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:19.323259 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323223 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323452 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323452 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-out\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323452 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323340 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323452 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323452 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323412 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323452 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323437 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323773 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323463 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2wmg\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-kube-api-access-c2wmg\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323773 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-web-config\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323773 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323536 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323773 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323571 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323773 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.323773 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323630 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.324071 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.323935 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.324803 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.324383 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.324803 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.324539 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.327139 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.327111 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.327658 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.327632 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.327658 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.327645 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.327862 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.327671 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-out\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.327862 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.327797 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.328062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.328022 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-web-config\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.328062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.328020 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.328209 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.328187 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.328776 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.328757 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.332936 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.332915 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2wmg\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-kube-api-access-c2wmg\") pod \"alertmanager-main-0\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:19.371075 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:19.371050 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:51:20.342211 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:20.342165 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:20.445625 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:20.445589 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:20.827080 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:20.827047 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d97f7f679-bwklk" Jul 07 18:51:20.872118 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:20.872066 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:20.981666 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:20.981603 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:21.044319 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:21.044283 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:21.139974 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:21.139937 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:21.231705 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:21.231660 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:21.357003 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:21.356926 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:22.063374 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:51:22.063328 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d59249_fe5a_4676_a015_34c406eb4544.slice/crio-e5992faf27ed7effbe13cb34bcc4eaf82e2ae44c17563cbca6fc1bc606128457 WatchSource:0}: Error finding container e5992faf27ed7effbe13cb34bcc4eaf82e2ae44c17563cbca6fc1bc606128457: Status 404 returned error can't find the container with id e5992faf27ed7effbe13cb34bcc4eaf82e2ae44c17563cbca6fc1bc606128457 Jul 07 18:51:22.201300 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.201271 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:51:22.204328 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:51:22.204289 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d82b8c3_9e2e_4453_8304_660547c8bd16.slice/crio-befde81e92f5c6361977b6c43a876292439c822bff090da98e83d5572724c031 WatchSource:0}: Error finding container befde81e92f5c6361977b6c43a876292439c822bff090da98e83d5572724c031: Status 404 returned error can't find the container with id befde81e92f5c6361977b6c43a876292439c822bff090da98e83d5572724c031 Jul 07 18:51:22.206126 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.206097 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fcfb874d8-ktspl"] Jul 07 18:51:22.356710 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.356679 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8486d8c78c-prjhx"] Jul 07 18:51:22.376115 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:51:22.376082 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda174a375_c80c_492d_bea8_08f0f3c1e2d0.slice/crio-842b6b7043d7c3250b922dbe4fac6c4f8e0f32abb93e1a9ef3c77f5ca9fcac30 WatchSource:0}: Error finding container 842b6b7043d7c3250b922dbe4fac6c4f8e0f32abb93e1a9ef3c77f5ca9fcac30: Status 404 returned error can't find the container with id 842b6b7043d7c3250b922dbe4fac6c4f8e0f32abb93e1a9ef3c77f5ca9fcac30 Jul 07 18:51:22.379945 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.379922 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8486d8c78c-prjhx"] Jul 07 18:51:22.380052 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.380018 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.382317 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.382298 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 18:51:22.382583 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.382553 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-879lx\"" Jul 07 18:51:22.382675 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.382562 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 18:51:22.382675 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.382642 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 18:51:22.382675 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.382663 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8fif47hbs5o0\"" Jul 07 18:51:22.382815 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.382561 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 18:51:22.551001 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.550964 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c8de9c9f-12b9-46fa-95b9-724acf14d60a-secret-metrics-server-tls\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.551001 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.551001 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8de9c9f-12b9-46fa-95b9-724acf14d60a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.551214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.551033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxs8v\" (UniqueName: \"kubernetes.io/projected/c8de9c9f-12b9-46fa-95b9-724acf14d60a-kube-api-access-fxs8v\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.551214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.551072 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c8de9c9f-12b9-46fa-95b9-724acf14d60a-metrics-server-audit-profiles\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.551214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.551127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8de9c9f-12b9-46fa-95b9-724acf14d60a-client-ca-bundle\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.551214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.551160 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c8de9c9f-12b9-46fa-95b9-724acf14d60a-secret-metrics-server-client-certs\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.551214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.551181 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c8de9c9f-12b9-46fa-95b9-724acf14d60a-audit-log\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.601029 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.600996 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:22.646094 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.646033 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv"] Jul 07 18:51:22.651817 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.651796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8de9c9f-12b9-46fa-95b9-724acf14d60a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.651890 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.651840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxs8v\" (UniqueName: \"kubernetes.io/projected/c8de9c9f-12b9-46fa-95b9-724acf14d60a-kube-api-access-fxs8v\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.651890 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.651871 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c8de9c9f-12b9-46fa-95b9-724acf14d60a-metrics-server-audit-profiles\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.651994 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.651913 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8de9c9f-12b9-46fa-95b9-724acf14d60a-client-ca-bundle\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.651994 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.651958 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c8de9c9f-12b9-46fa-95b9-724acf14d60a-secret-metrics-server-client-certs\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.652119 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.652091 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c8de9c9f-12b9-46fa-95b9-724acf14d60a-audit-log\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.652178 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.652159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c8de9c9f-12b9-46fa-95b9-724acf14d60a-secret-metrics-server-tls\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.652521 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.652457 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c8de9c9f-12b9-46fa-95b9-724acf14d60a-audit-log\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.652655 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.652633 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8de9c9f-12b9-46fa-95b9-724acf14d60a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.652971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.652945 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c8de9c9f-12b9-46fa-95b9-724acf14d60a-metrics-server-audit-profiles\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.654419 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.654399 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8de9c9f-12b9-46fa-95b9-724acf14d60a-client-ca-bundle\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.654660 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.654637 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c8de9c9f-12b9-46fa-95b9-724acf14d60a-secret-metrics-server-client-certs\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.655313 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.655291 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c8de9c9f-12b9-46fa-95b9-724acf14d60a-secret-metrics-server-tls\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.661557 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.661519 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:22.664489 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.664464 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bpxjr\"" Jul 07 18:51:22.664759 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.664738 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 18:51:22.665260 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.665239 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv"] Jul 07 18:51:22.670746 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.670454 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxs8v\" (UniqueName: \"kubernetes.io/projected/c8de9c9f-12b9-46fa-95b9-724acf14d60a-kube-api-access-fxs8v\") pod \"metrics-server-8486d8c78c-prjhx\" (UID: \"c8de9c9f-12b9-46fa-95b9-724acf14d60a\") " pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.686601 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.686575 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:22.690498 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.690476 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:22.753695 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.753663 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l28d7\" (UniqueName: \"kubernetes.io/projected/be883a99-f776-4f66-9b9b-6e1306c97b04-kube-api-access-l28d7\") pod \"monitoring-plugin-d5dcff7cf-b6hqv\" (UID: \"be883a99-f776-4f66-9b9b-6e1306c97b04\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:22.753804 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.753735 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be883a99-f776-4f66-9b9b-6e1306c97b04-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-b6hqv\" (UID: \"be883a99-f776-4f66-9b9b-6e1306c97b04\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:22.819814 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.819776 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:22.854997 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.854966 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be883a99-f776-4f66-9b9b-6e1306c97b04-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-b6hqv\" (UID: \"be883a99-f776-4f66-9b9b-6e1306c97b04\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:22.855128 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.855067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l28d7\" (UniqueName: \"kubernetes.io/projected/be883a99-f776-4f66-9b9b-6e1306c97b04-kube-api-access-l28d7\") pod \"monitoring-plugin-d5dcff7cf-b6hqv\" (UID: \"be883a99-f776-4f66-9b9b-6e1306c97b04\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:22.857663 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.857638 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be883a99-f776-4f66-9b9b-6e1306c97b04-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-b6hqv\" (UID: \"be883a99-f776-4f66-9b9b-6e1306c97b04\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:22.864961 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.864879 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8486d8c78c-prjhx"] Jul 07 18:51:22.868021 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.867845 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l28d7\" (UniqueName: \"kubernetes.io/projected/be883a99-f776-4f66-9b9b-6e1306c97b04-kube-api-access-l28d7\") pod \"monitoring-plugin-d5dcff7cf-b6hqv\" (UID: \"be883a99-f776-4f66-9b9b-6e1306c97b04\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:22.869993 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:51:22.869941 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8de9c9f_12b9_46fa_95b9_724acf14d60a.slice/crio-d6b1e8835f20561fac38ad470fb2a401385a798134a0333f432f8a06883a559e WatchSource:0}: Error finding container d6b1e8835f20561fac38ad470fb2a401385a798134a0333f432f8a06883a559e: Status 404 returned error can't find the container with id d6b1e8835f20561fac38ad470fb2a401385a798134a0333f432f8a06883a559e Jul 07 18:51:22.914643 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.914556 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcfb874d8-ktspl" event={"ID":"a174a375-c80c-492d-bea8-08f0f3c1e2d0","Type":"ContainerStarted","Data":"842b6b7043d7c3250b922dbe4fac6c4f8e0f32abb93e1a9ef3c77f5ca9fcac30"} Jul 07 18:51:22.917262 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.917205 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" event={"ID":"c8de9c9f-12b9-46fa-95b9-724acf14d60a","Type":"ContainerStarted","Data":"d6b1e8835f20561fac38ad470fb2a401385a798134a0333f432f8a06883a559e"} Jul 07 18:51:22.921205 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.921178 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:22.922037 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.921952 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerStarted","Data":"befde81e92f5c6361977b6c43a876292439c822bff090da98e83d5572724c031"} Jul 07 18:51:22.925187 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.925161 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4pjg" event={"ID":"b3d59249-fe5a-4676-a015-34c406eb4544","Type":"ContainerStarted","Data":"e5992faf27ed7effbe13cb34bcc4eaf82e2ae44c17563cbca6fc1bc606128457"} Jul 07 18:51:22.927866 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.927842 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-hgmd9" event={"ID":"50e5cae2-5fbe-4e24-b94d-d922317bafd7","Type":"ContainerStarted","Data":"a10935928ce1714e470f4357a6e77e3d0cb4931fe4450a45fb88d81cab08fff3"} Jul 07 18:51:22.928229 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.928188 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-hgmd9" Jul 07 18:51:22.930225 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.930153 2582 patch_prober.go:28] interesting pod/downloads-685bfb5f64-hgmd9 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" start-of-body= Jul 07 18:51:22.930335 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.930262 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-hgmd9" podUID="50e5cae2-5fbe-4e24-b94d-d922317bafd7" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" Jul 07 18:51:22.953235 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.952179 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-hgmd9" podStartSLOduration=1.304322493 podStartE2EDuration="24.95216194s" totalImagesPullingTime="23.647839447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:22.952104658 +0000 UTC m=+91.011552409" watchObservedRunningTime="2026-07-07 18:51:22.95216194 +0000 UTC m=+91.011609693" Jul 07 18:51:22.973098 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:22.973077 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:23.024366 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.024267 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:23.147045 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.145384 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d968c6994-vfphx"] Jul 07 18:51:23.153092 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.153066 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.156213 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.155533 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 18:51:23.156213 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.155746 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 18:51:23.156213 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.155830 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 18:51:23.156213 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.155534 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 18:51:23.156213 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.156087 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6lllr\"" Jul 07 18:51:23.156679 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.156252 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 18:51:23.167208 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.166343 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d968c6994-vfphx"] Jul 07 18:51:23.167208 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.166470 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 18:51:23.172303 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.171578 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv"] Jul 07 18:51:23.179462 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:51:23.179433 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe883a99_f776_4f66_9b9b_6e1306c97b04.slice/crio-dabffdbf43f637dbe80cee8015c03cc3dd2164dcba58f8c57635ba7b88794499 WatchSource:0}: Error finding container dabffdbf43f637dbe80cee8015c03cc3dd2164dcba58f8c57635ba7b88794499: Status 404 returned error can't find the container with id dabffdbf43f637dbe80cee8015c03cc3dd2164dcba58f8c57635ba7b88794499 Jul 07 18:51:23.267621 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.267566 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4e2c80-d9b8-439b-82fd-18270686a609-serving-certs-ca-bundle\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.267775 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.267624 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4e2c80-d9b8-439b-82fd-18270686a609-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.267775 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.267689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.267775 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.267723 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-federate-client-tls\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.267775 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.267750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad4e2c80-d9b8-439b-82fd-18270686a609-metrics-client-ca\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.268049 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.267815 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-telemeter-client-tls\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.268049 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.267853 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-secret-telemeter-client\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.268049 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.267878 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl9rv\" (UniqueName: \"kubernetes.io/projected/ad4e2c80-d9b8-439b-82fd-18270686a609-kube-api-access-xl9rv\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.369055 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.369018 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-federate-client-tls\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.369245 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.369072 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad4e2c80-d9b8-439b-82fd-18270686a609-metrics-client-ca\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.369245 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.369123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-telemeter-client-tls\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.369245 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.369161 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-secret-telemeter-client\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.369245 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.369187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl9rv\" (UniqueName: \"kubernetes.io/projected/ad4e2c80-d9b8-439b-82fd-18270686a609-kube-api-access-xl9rv\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.369245 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.369238 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4e2c80-d9b8-439b-82fd-18270686a609-serving-certs-ca-bundle\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.369573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.369269 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4e2c80-d9b8-439b-82fd-18270686a609-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.369573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.369321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.373193 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.370782 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4e2c80-d9b8-439b-82fd-18270686a609-serving-certs-ca-bundle\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.373193 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.371702 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad4e2c80-d9b8-439b-82fd-18270686a609-metrics-client-ca\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.373193 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.373153 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4e2c80-d9b8-439b-82fd-18270686a609-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.375815 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.375425 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.375815 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.375738 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-secret-telemeter-client\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.377395 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.376955 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-telemeter-client-tls\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.378658 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.378626 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad4e2c80-d9b8-439b-82fd-18270686a609-federate-client-tls\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.389490 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.389455 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl9rv\" (UniqueName: \"kubernetes.io/projected/ad4e2c80-d9b8-439b-82fd-18270686a609-kube-api-access-xl9rv\") pod \"telemeter-client-7d968c6994-vfphx\" (UID: \"ad4e2c80-d9b8-439b-82fd-18270686a609\") " pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.474212 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.473938 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" Jul 07 18:51:23.761331 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.761252 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:23.822054 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.822001 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:23.929059 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.929023 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fcfb874d8-ktspl"] Jul 07 18:51:23.938688 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.938479 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" event={"ID":"be883a99-f776-4f66-9b9b-6e1306c97b04","Type":"ContainerStarted","Data":"dabffdbf43f637dbe80cee8015c03cc3dd2164dcba58f8c57635ba7b88794499"} Jul 07 18:51:23.954531 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:23.954503 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-hgmd9" Jul 07 18:51:24.180758 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:24.180705 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:25.196388 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:25.196318 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:25.296666 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:25.296630 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:27.329511 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:27.329483 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d968c6994-vfphx"] Jul 07 18:51:27.463331 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:51:27.463298 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4e2c80_d9b8_439b_82fd_18270686a609.slice/crio-cd986e7beb26a4006d5e14ac9f38bda7f329c4a6a15f3b20ce7c0675152be3ee WatchSource:0}: Error finding container cd986e7beb26a4006d5e14ac9f38bda7f329c4a6a15f3b20ce7c0675152be3ee: Status 404 returned error can't find the container with id cd986e7beb26a4006d5e14ac9f38bda7f329c4a6a15f3b20ce7c0675152be3ee Jul 07 18:51:27.957137 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:27.957101 2582 generic.go:356] "Generic (PLEG): container finished" podID="b3d59249-fe5a-4676-a015-34c406eb4544" containerID="f0991a43938b7bf2a4261953a64616ef4558df316e7b7b6bb6c90bebde120e60" exitCode=0 Jul 07 18:51:27.957276 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:27.957193 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4pjg" event={"ID":"b3d59249-fe5a-4676-a015-34c406eb4544","Type":"ContainerDied","Data":"f0991a43938b7bf2a4261953a64616ef4558df316e7b7b6bb6c90bebde120e60"} Jul 07 18:51:27.958838 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:27.958814 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" event={"ID":"ad4e2c80-d9b8-439b-82fd-18270686a609","Type":"ContainerStarted","Data":"cd986e7beb26a4006d5e14ac9f38bda7f329c4a6a15f3b20ce7c0675152be3ee"} Jul 07 18:51:27.960684 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:27.960662 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" event={"ID":"c8de9c9f-12b9-46fa-95b9-724acf14d60a","Type":"ContainerStarted","Data":"b2d9835542b3a0a999432d00a067477fd1f93540543861a6a67ccdeb2c1535f0"} Jul 07 18:51:27.962503 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:27.962477 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerID="e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9" exitCode=0 Jul 07 18:51:27.962620 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:27.962529 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerDied","Data":"e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9"} Jul 07 18:51:28.003125 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:28.003071 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" podStartSLOduration=1.7157070970000001 podStartE2EDuration="6.003052824s" totalImagesPullingTime="4.287345727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:28.002921389 +0000 UTC m=+96.062369141" watchObservedRunningTime="2026-07-07 18:51:28.003052824 +0000 UTC m=+96.062500579" Jul 07 18:51:28.970868 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:28.970778 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcfb874d8-ktspl" event={"ID":"a174a375-c80c-492d-bea8-08f0f3c1e2d0","Type":"ContainerStarted","Data":"0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88"} Jul 07 18:51:28.975203 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:28.975095 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" event={"ID":"be883a99-f776-4f66-9b9b-6e1306c97b04","Type":"ContainerStarted","Data":"fb05a994cb4652cdea2fbcc771eb3d975c4a4a8b260f4b56542fe3025b031d80"} Jul 07 18:51:28.978915 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:28.978424 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4pjg" event={"ID":"b3d59249-fe5a-4676-a015-34c406eb4544","Type":"ContainerStarted","Data":"345caa4d3faef51f1bcba5629665fdc8d4d4ab42ac5c3d44fa3d5a32b9560dff"} Jul 07 18:51:28.978915 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:28.978475 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f4pjg" event={"ID":"b3d59249-fe5a-4676-a015-34c406eb4544","Type":"ContainerStarted","Data":"967b035723e5c22f0ace3a62231223824774393bfd0fb0cbebad81cfa4d3783e"} Jul 07 18:51:28.992321 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:28.991721 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fcfb874d8-ktspl" podStartSLOduration=6.433266429 podStartE2EDuration="11.99170264s" totalImagesPullingTime="5.558436211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:28.990477208 +0000 UTC m=+97.049924959" watchObservedRunningTime="2026-07-07 18:51:28.99170264 +0000 UTC m=+97.051150393" Jul 07 18:51:29.015672 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:29.015227 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f4pjg" podStartSLOduration=6.824336477 podStartE2EDuration="12.015207986s" totalImagesPullingTime="5.091427014s" totalInitContainerRuntime="99.444495ms" isStatefulPod=true podCreationTimestamp="2026-07-07 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:29.013714278 +0000 UTC m=+97.073162033" watchObservedRunningTime="2026-07-07 18:51:29.015207986 +0000 UTC m=+97.074655737" Jul 07 18:51:29.984504 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:29.984410 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:29.989959 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:29.989932 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" Jul 07 18:51:30.008651 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:30.008579 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-b6hqv" podStartSLOduration=2.9258529920000003 podStartE2EDuration="8.008560342s" totalImagesPullingTime="5.08270735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:29.033518485 +0000 UTC m=+97.092966238" watchObservedRunningTime="2026-07-07 18:51:30.008560342 +0000 UTC m=+98.068008095" Jul 07 18:51:30.991194 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:30.991164 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" event={"ID":"ad4e2c80-d9b8-439b-82fd-18270686a609","Type":"ContainerStarted","Data":"73f0710c684201f77f2f606c9041ddfbd7040f50f3f169f0c818b58e8b51b144"} Jul 07 18:51:30.991569 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:30.991245 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" event={"ID":"ad4e2c80-d9b8-439b-82fd-18270686a609","Type":"ContainerStarted","Data":"38d7be7452e19a8c5f269f66932ab7d00fe90252204270d46edaea8c20df7b4b"} Jul 07 18:51:30.993958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:30.993931 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerStarted","Data":"c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb"} Jul 07 18:51:30.994056 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:30.994004 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerStarted","Data":"ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985"} Jul 07 18:51:31.999240 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:31.999200 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" event={"ID":"ad4e2c80-d9b8-439b-82fd-18270686a609","Type":"ContainerStarted","Data":"55f3fcd22600c044fa5778f89467c1527d8a32581e647da65e7fd3ae06eec686"} Jul 07 18:51:32.002034 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:32.002008 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerStarted","Data":"639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582"} Jul 07 18:51:32.002149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:32.002065 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerStarted","Data":"9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45"} Jul 07 18:51:32.002149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:32.002094 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerStarted","Data":"81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab"} Jul 07 18:51:32.024461 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:32.024418 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d968c6994-vfphx" podStartSLOduration=5.7925476190000005 podStartE2EDuration="9.024404337s" totalImagesPullingTime="3.231856718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:32.023085446 +0000 UTC m=+100.082533196" watchObservedRunningTime="2026-07-07 18:51:32.024404337 +0000 UTC m=+100.083852087" Jul 07 18:51:32.084089 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:32.084055 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:32.183691 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:32.183660 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:33.011132 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:33.011092 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerStarted","Data":"c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4"} Jul 07 18:51:33.025110 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:33.025083 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:33.041773 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:33.041730 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.280433468 podStartE2EDuration="14.041716958s" totalImagesPullingTime="8.738305079s" totalInitContainerRuntime="22.978411ms" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:33.039033932 +0000 UTC m=+101.098481683" watchObservedRunningTime="2026-07-07 18:51:33.041716958 +0000 UTC m=+101.101164711" Jul 07 18:51:33.123925 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:33.123891 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:33.620525 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:33.620486 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:33.725441 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:33.725411 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:34.224402 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:34.224348 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:37.155732 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:37.155697 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:37.255608 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:37.255574 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:37.594559 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:37.594475 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:37.698856 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:37.698819 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:37.841569 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:37.841541 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:37.857825 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:37.857806 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t59k8" Jul 07 18:51:40.526954 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:40.526915 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:40.626534 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:40.626498 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:41.182552 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:41.182520 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:41.268305 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:41.268269 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:42.690971 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:42.690945 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:42.691336 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:42.690994 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:51:44.435333 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:44.435300 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:44.541233 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:44.541195 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:44.645628 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:44.645581 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:51:54.000938 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.000875 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5fcfb874d8-ktspl" podUID="a174a375-c80c-492d-bea8-08f0f3c1e2d0" containerName="console" containerID="cri-o://0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88" gracePeriod=15 Jul 07 18:51:54.275885 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.275818 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:54.348508 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.348478 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-serving-cert\") pod \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " Jul 07 18:51:54.348644 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.348557 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-config\") pod \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " Jul 07 18:51:54.348644 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.348600 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-trusted-ca-bundle\") pod \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " Jul 07 18:51:54.348644 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.348623 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzp5x\" (UniqueName: \"kubernetes.io/projected/a174a375-c80c-492d-bea8-08f0f3c1e2d0-kube-api-access-bzp5x\") pod \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " Jul 07 18:51:54.348804 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.348669 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-service-ca\") pod \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " Jul 07 18:51:54.348804 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.348711 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-oauth-config\") pod \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " Jul 07 18:51:54.348804 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.348755 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-oauth-serving-cert\") pod \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\" (UID: \"a174a375-c80c-492d-bea8-08f0f3c1e2d0\") " Jul 07 18:51:54.349081 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.349054 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-config" (OuterVolumeSpecName: "console-config") pod "a174a375-c80c-492d-bea8-08f0f3c1e2d0" (UID: "a174a375-c80c-492d-bea8-08f0f3c1e2d0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:51:54.349153 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.349060 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a174a375-c80c-492d-bea8-08f0f3c1e2d0" (UID: "a174a375-c80c-492d-bea8-08f0f3c1e2d0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:51:54.349153 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.349100 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-service-ca" (OuterVolumeSpecName: "service-ca") pod "a174a375-c80c-492d-bea8-08f0f3c1e2d0" (UID: "a174a375-c80c-492d-bea8-08f0f3c1e2d0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:51:54.349227 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.349157 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a174a375-c80c-492d-bea8-08f0f3c1e2d0" (UID: "a174a375-c80c-492d-bea8-08f0f3c1e2d0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:51:54.350742 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.350720 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a174a375-c80c-492d-bea8-08f0f3c1e2d0" (UID: "a174a375-c80c-492d-bea8-08f0f3c1e2d0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:51:54.350889 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.350869 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a174a375-c80c-492d-bea8-08f0f3c1e2d0" (UID: "a174a375-c80c-492d-bea8-08f0f3c1e2d0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:51:54.350947 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.350928 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a174a375-c80c-492d-bea8-08f0f3c1e2d0-kube-api-access-bzp5x" (OuterVolumeSpecName: "kube-api-access-bzp5x") pod "a174a375-c80c-492d-bea8-08f0f3c1e2d0" (UID: "a174a375-c80c-492d-bea8-08f0f3c1e2d0"). InnerVolumeSpecName "kube-api-access-bzp5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:51:54.449402 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.449374 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-trusted-ca-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:51:54.449402 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.449399 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzp5x\" (UniqueName: \"kubernetes.io/projected/a174a375-c80c-492d-bea8-08f0f3c1e2d0-kube-api-access-bzp5x\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:51:54.449402 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.449410 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-service-ca\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:51:54.449645 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.449418 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-oauth-config\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:51:54.449645 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.449427 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-oauth-serving-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:51:54.449645 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.449436 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-serving-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:51:54.449645 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:54.449444 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a174a375-c80c-492d-bea8-08f0f3c1e2d0-console-config\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:51:55.091718 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:55.091679 2582 generic.go:356] "Generic (PLEG): container finished" podID="a174a375-c80c-492d-bea8-08f0f3c1e2d0" containerID="0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88" exitCode=0 Jul 07 18:51:55.092167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:55.091730 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fcfb874d8-ktspl" Jul 07 18:51:55.092167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:55.091766 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcfb874d8-ktspl" event={"ID":"a174a375-c80c-492d-bea8-08f0f3c1e2d0","Type":"ContainerDied","Data":"0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88"} Jul 07 18:51:55.092167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:55.091822 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fcfb874d8-ktspl" event={"ID":"a174a375-c80c-492d-bea8-08f0f3c1e2d0","Type":"ContainerDied","Data":"842b6b7043d7c3250b922dbe4fac6c4f8e0f32abb93e1a9ef3c77f5ca9fcac30"} Jul 07 18:51:55.092167 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:55.091847 2582 scope.go:117] "RemoveContainer" containerID="0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88" Jul 07 18:51:55.099956 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:55.099937 2582 scope.go:117] "RemoveContainer" containerID="0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88" Jul 07 18:51:55.100196 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:51:55.100175 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88\": container with ID starting with 0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88 not found: ID does not exist" containerID="0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88" Jul 07 18:51:55.100257 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:55.100203 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88"} err="failed to get container status \"0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88\": rpc error: code = NotFound desc = could not find container \"0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88\": container with ID starting with 0a57c8c3d6787766b6b9585d5082064b3848b1febe1dccf7190ac17efab23a88 not found: ID does not exist" Jul 07 18:51:55.112210 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:55.112183 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fcfb874d8-ktspl"] Jul 07 18:51:55.120171 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:55.120150 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fcfb874d8-ktspl"] Jul 07 18:51:56.532173 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:51:56.532141 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a174a375-c80c-492d-bea8-08f0f3c1e2d0" path="/var/lib/kubelet/pods/a174a375-c80c-492d-bea8-08f0f3c1e2d0/volumes" Jul 07 18:52:01.120811 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:01.120780 2582 generic.go:356] "Generic (PLEG): container finished" podID="5f1b3266-060f-4be8-a5f0-3f066792323e" containerID="14da552df7957b23ab1fe4f9e87a66199a26d160fc5da8aa7e2ac524a7c741e6" exitCode=0 Jul 07 18:52:01.121241 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:01.120859 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" event={"ID":"5f1b3266-060f-4be8-a5f0-3f066792323e","Type":"ContainerDied","Data":"14da552df7957b23ab1fe4f9e87a66199a26d160fc5da8aa7e2ac524a7c741e6"} Jul 07 18:52:01.121241 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:01.121129 2582 scope.go:117] "RemoveContainer" containerID="14da552df7957b23ab1fe4f9e87a66199a26d160fc5da8aa7e2ac524a7c741e6" Jul 07 18:52:02.125944 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:02.125910 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zlwhv" event={"ID":"5f1b3266-060f-4be8-a5f0-3f066792323e","Type":"ContainerStarted","Data":"5284fa9a45d7388574385ea1e66e63872fa33cce4f5a32038992f7bb39da5808"} Jul 07 18:52:02.695992 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:02.695961 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:52:02.713559 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:02.713526 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8486d8c78c-prjhx" Jul 07 18:52:07.622448 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:07.622411 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:07.687831 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:07.687790 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:23.146248 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:23.146209 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:34.070188 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:34.070140 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:34.131809 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:34.131771 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:38.231589 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:38.231534 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:38.397156 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:38.397115 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:52:38.397487 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:38.397459 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="alertmanager" containerID="cri-o://ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985" gracePeriod=120 Jul 07 18:52:38.397601 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:38.397512 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy-metric" containerID="cri-o://639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582" gracePeriod=120 Jul 07 18:52:38.397601 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:38.397551 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy-web" containerID="cri-o://81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab" gracePeriod=120 Jul 07 18:52:38.397601 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:38.397575 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy" containerID="cri-o://9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45" gracePeriod=120 Jul 07 18:52:38.397766 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:38.397593 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="config-reloader" containerID="cri-o://c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb" gracePeriod=120 Jul 07 18:52:38.397766 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:38.397630 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="prom-label-proxy" containerID="cri-o://c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4" gracePeriod=120 Jul 07 18:52:39.264759 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264726 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerID="c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4" exitCode=0 Jul 07 18:52:39.264759 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264752 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerID="639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582" exitCode=0 Jul 07 18:52:39.264759 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264759 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerID="9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45" exitCode=0 Jul 07 18:52:39.264759 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264765 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerID="c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb" exitCode=0 Jul 07 18:52:39.264759 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264770 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerID="ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985" exitCode=0 Jul 07 18:52:39.265255 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264811 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerDied","Data":"c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4"} Jul 07 18:52:39.265255 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264904 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerDied","Data":"639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582"} Jul 07 18:52:39.265255 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264929 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerDied","Data":"9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45"} Jul 07 18:52:39.265255 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264953 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerDied","Data":"c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb"} Jul 07 18:52:39.265255 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.264976 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerDied","Data":"ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985"} Jul 07 18:52:39.629566 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.629543 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:39.697845 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.697818 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-metrics-client-ca\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698009 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.697860 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-volume\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698009 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.697879 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-main-tls\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698009 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.697916 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698009 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.697932 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-out\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698009 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.697963 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698009 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.697987 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-tls-assets\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698009 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.698010 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2wmg\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-kube-api-access-c2wmg\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698397 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.698029 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-trusted-ca-bundle\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698397 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.698062 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-cluster-tls-config\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698397 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.698092 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-main-db\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698397 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.698116 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-web\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.698397 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.698160 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-web-config\") pod \"8d82b8c3-9e2e-4453-8304-660547c8bd16\" (UID: \"8d82b8c3-9e2e-4453-8304-660547c8bd16\") " Jul 07 18:52:39.708490 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.700649 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:52:39.708490 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.700805 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:52:39.708490 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.701177 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-out" (OuterVolumeSpecName: "config-out") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:52:39.708490 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.698253 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:52:39.708490 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.701936 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:52:39.709022 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.708906 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:52:39.709801 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.709757 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:52:39.709801 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.709779 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-kube-api-access-c2wmg" (OuterVolumeSpecName: "kube-api-access-c2wmg") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "kube-api-access-c2wmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:52:39.710109 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.710077 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-volume" (OuterVolumeSpecName: "config-volume") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:52:39.710515 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.710491 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:52:39.711303 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.711276 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:52:39.713642 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.713609 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:52:39.719679 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.719655 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-web-config" (OuterVolumeSpecName: "web-config") pod "8d82b8c3-9e2e-4453-8304-660547c8bd16" (UID: "8d82b8c3-9e2e-4453-8304-660547c8bd16"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:52:39.802217 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802194 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-metrics-client-ca\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802217 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802215 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-volume\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802227 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-main-tls\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802237 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802246 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-config-out\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802254 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802263 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-tls-assets\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802271 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2wmg\" (UniqueName: \"kubernetes.io/projected/8d82b8c3-9e2e-4453-8304-660547c8bd16-kube-api-access-c2wmg\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802279 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802287 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-cluster-tls-config\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802296 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d82b8c3-9e2e-4453-8304-660547c8bd16-alertmanager-main-db\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802304 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:39.802374 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:39.802313 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d82b8c3-9e2e-4453-8304-660547c8bd16-web-config\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:52:40.271388 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.271335 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerID="81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab" exitCode=0 Jul 07 18:52:40.271800 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.271426 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerDied","Data":"81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab"} Jul 07 18:52:40.271800 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.271441 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.271800 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.271535 2582 scope.go:117] "RemoveContainer" containerID="c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4" Jul 07 18:52:40.271800 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.271524 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d82b8c3-9e2e-4453-8304-660547c8bd16","Type":"ContainerDied","Data":"befde81e92f5c6361977b6c43a876292439c822bff090da98e83d5572724c031"} Jul 07 18:52:40.279207 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.279146 2582 scope.go:117] "RemoveContainer" containerID="639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582" Jul 07 18:52:40.286042 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.286023 2582 scope.go:117] "RemoveContainer" containerID="9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45" Jul 07 18:52:40.292468 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.292453 2582 scope.go:117] "RemoveContainer" containerID="81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab" Jul 07 18:52:40.298646 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.298630 2582 scope.go:117] "RemoveContainer" containerID="c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb" Jul 07 18:52:40.302778 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.302513 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:52:40.306145 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.306128 2582 scope.go:117] "RemoveContainer" containerID="ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985" Jul 07 18:52:40.310740 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.310722 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:52:40.312991 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.312975 2582 scope.go:117] "RemoveContainer" containerID="e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9" Jul 07 18:52:40.319421 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.319403 2582 scope.go:117] "RemoveContainer" containerID="c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4" Jul 07 18:52:40.319656 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:52:40.319635 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4\": container with ID starting with c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4 not found: ID does not exist" containerID="c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4" Jul 07 18:52:40.319712 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.319662 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4"} err="failed to get container status \"c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4\": rpc error: code = NotFound desc = could not find container \"c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4\": container with ID starting with c8bc972d5b8be64764d530ff4cdb2397a9909bba90045a50eedbfd6b7c137ff4 not found: ID does not exist" Jul 07 18:52:40.319712 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.319680 2582 scope.go:117] "RemoveContainer" containerID="639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582" Jul 07 18:52:40.319869 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:52:40.319855 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582\": container with ID starting with 639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582 not found: ID does not exist" containerID="639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582" Jul 07 18:52:40.319910 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.319872 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582"} err="failed to get container status \"639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582\": rpc error: code = NotFound desc = could not find container \"639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582\": container with ID starting with 639f170e275f937d9286efed9db2c93533ae1334575223dc9a51a355f4b46582 not found: ID does not exist" Jul 07 18:52:40.319910 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.319884 2582 scope.go:117] "RemoveContainer" containerID="9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45" Jul 07 18:52:40.320063 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:52:40.320047 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45\": container with ID starting with 9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45 not found: ID does not exist" containerID="9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45" Jul 07 18:52:40.320106 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.320068 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45"} err="failed to get container status \"9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45\": rpc error: code = NotFound desc = could not find container \"9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45\": container with ID starting with 9c88c71d4e891effcce4d7d0c8e3dc5f660be5d452343d7ae70878e6cd8eee45 not found: ID does not exist" Jul 07 18:52:40.320106 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.320079 2582 scope.go:117] "RemoveContainer" containerID="81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab" Jul 07 18:52:40.320301 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:52:40.320283 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab\": container with ID starting with 81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab not found: ID does not exist" containerID="81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab" Jul 07 18:52:40.320373 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.320310 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab"} err="failed to get container status \"81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab\": rpc error: code = NotFound desc = could not find container \"81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab\": container with ID starting with 81b0980414a814f2b9670b48897677bc402677a33bce03494d251034e6a1faab not found: ID does not exist" Jul 07 18:52:40.320373 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.320333 2582 scope.go:117] "RemoveContainer" containerID="c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb" Jul 07 18:52:40.320585 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:52:40.320568 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb\": container with ID starting with c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb not found: ID does not exist" containerID="c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb" Jul 07 18:52:40.320625 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.320591 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb"} err="failed to get container status \"c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb\": rpc error: code = NotFound desc = could not find container \"c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb\": container with ID starting with c0299ad403d3e780758f37a2fc27b7d23aa62ebea21fa2f5424f8f550ed9f5bb not found: ID does not exist" Jul 07 18:52:40.320625 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.320606 2582 scope.go:117] "RemoveContainer" containerID="ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985" Jul 07 18:52:40.320793 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:52:40.320779 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985\": container with ID starting with ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985 not found: ID does not exist" containerID="ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985" Jul 07 18:52:40.320842 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.320797 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985"} err="failed to get container status \"ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985\": rpc error: code = NotFound desc = could not find container \"ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985\": container with ID starting with ec4d959b7eab3e29f1fff0ff37a303af5a2858d64d508d8e1f2ab8c88d14b985 not found: ID does not exist" Jul 07 18:52:40.320842 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.320810 2582 scope.go:117] "RemoveContainer" containerID="e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9" Jul 07 18:52:40.321000 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:52:40.320985 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9\": container with ID starting with e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9 not found: ID does not exist" containerID="e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9" Jul 07 18:52:40.321042 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.321003 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9"} err="failed to get container status \"e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9\": rpc error: code = NotFound desc = could not find container \"e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9\": container with ID starting with e1d12d3f89f9b663bd5331f1fba5d6490489e493fea802ac99b87cd842c17aa9 not found: ID does not exist" Jul 07 18:52:40.352762 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.352737 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:52:40.353004 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.352993 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="prom-label-proxy" Jul 07 18:52:40.353046 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353006 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="prom-label-proxy" Jul 07 18:52:40.353046 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353014 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="init-config-reloader" Jul 07 18:52:40.353046 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353020 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="init-config-reloader" Jul 07 18:52:40.353046 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353028 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a174a375-c80c-492d-bea8-08f0f3c1e2d0" containerName="console" Jul 07 18:52:40.353046 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353034 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a174a375-c80c-492d-bea8-08f0f3c1e2d0" containerName="console" Jul 07 18:52:40.353046 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353040 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="alertmanager" Jul 07 18:52:40.353046 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353045 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="alertmanager" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353059 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="config-reloader" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353064 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="config-reloader" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353074 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy-web" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353079 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy-web" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353086 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353091 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353098 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy-metric" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353103 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy-metric" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353146 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353154 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a174a375-c80c-492d-bea8-08f0f3c1e2d0" containerName="console" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353159 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="prom-label-proxy" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353165 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy-metric" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353172 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="kube-rbac-proxy-web" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353178 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="alertmanager" Jul 07 18:52:40.353246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.353183 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" containerName="config-reloader" Jul 07 18:52:40.357209 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.357194 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.359880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.359865 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 18:52:40.359880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.359869 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 18:52:40.360161 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.360146 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lj7zx\"" Jul 07 18:52:40.360457 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.360440 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 18:52:40.360457 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.360452 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 18:52:40.360589 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.360448 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 18:52:40.360589 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.360474 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 18:52:40.360589 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.360494 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 18:52:40.360589 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.360452 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 18:52:40.365658 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.365636 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 18:52:40.376520 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.376502 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:52:40.405314 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405293 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405435 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405319 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-config-out\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405435 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405435 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405375 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405591 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-web-config\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405591 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405591 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405499 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405591 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405591 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405782 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405609 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405782 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405635 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405782 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405656 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8nzd\" (UniqueName: \"kubernetes.io/projected/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-kube-api-access-q8nzd\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.405782 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.405691 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506287 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506251 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506396 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-web-config\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506396 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506514 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506514 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506514 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506461 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506656 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506514 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506656 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506570 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506656 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506617 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nzd\" (UniqueName: \"kubernetes.io/projected/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-kube-api-access-q8nzd\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506656 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506856 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506687 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506856 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506711 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-config-out\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.506856 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.506737 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.507238 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.507212 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.507333 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.507249 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.508028 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.508000 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.509442 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.509344 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.509442 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.509381 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.509600 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.509452 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.509600 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.509476 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.509600 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.509508 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.509969 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.509947 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.510452 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.510434 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.510782 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.510763 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-web-config\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.511207 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.511190 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-config-out\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.516837 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.516815 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8nzd\" (UniqueName: \"kubernetes.io/projected/5e2b89ac-39d2-4c4b-8a6c-34170ca76db5-kube-api-access-q8nzd\") pod \"alertmanager-main-0\" (UID: \"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.530238 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.530184 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d82b8c3-9e2e-4453-8304-660547c8bd16" path="/var/lib/kubelet/pods/8d82b8c3-9e2e-4453-8304-660547c8bd16/volumes" Jul 07 18:52:40.666300 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.666267 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:52:40.800925 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:40.800845 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:52:40.804073 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:52:40.804045 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2b89ac_39d2_4c4b_8a6c_34170ca76db5.slice/crio-85e3c1341e386c8f69fdb5f048063669cad587726c6fc58ba4b496caa2b3faba WatchSource:0}: Error finding container 85e3c1341e386c8f69fdb5f048063669cad587726c6fc58ba4b496caa2b3faba: Status 404 returned error can't find the container with id 85e3c1341e386c8f69fdb5f048063669cad587726c6fc58ba4b496caa2b3faba Jul 07 18:52:41.282738 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:41.282699 2582 generic.go:356] "Generic (PLEG): container finished" podID="5e2b89ac-39d2-4c4b-8a6c-34170ca76db5" containerID="cd90d46ffb66bfdadd5ad5a526da99416dfed60ef1d887073115054ba3465e08" exitCode=0 Jul 07 18:52:41.283186 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:41.282746 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5","Type":"ContainerDied","Data":"cd90d46ffb66bfdadd5ad5a526da99416dfed60ef1d887073115054ba3465e08"} Jul 07 18:52:41.283186 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:41.282846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5","Type":"ContainerStarted","Data":"85e3c1341e386c8f69fdb5f048063669cad587726c6fc58ba4b496caa2b3faba"} Jul 07 18:52:42.289054 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:42.289014 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5","Type":"ContainerStarted","Data":"6042e589dd2c57e9c7886b5fa5015f9b4f9fcb57c5cae2a123fd643c4f66bbf2"} Jul 07 18:52:42.289480 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:42.289098 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5","Type":"ContainerStarted","Data":"9442f94eba71903ed5eee73cb1895087e18eb421ad6cc96299a7a4de920ff15f"} Jul 07 18:52:42.289480 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:42.289139 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5","Type":"ContainerStarted","Data":"fbda6882a68c712b1c87fd2fc9dec454cd59f97846eb59644aff2ceb3744f081"} Jul 07 18:52:42.289480 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:42.289177 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5","Type":"ContainerStarted","Data":"1899806f5fcd502d4003a7cc8aed469b8e18ad3da2d7c7ff21e3a4b2404131ca"} Jul 07 18:52:42.289480 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:42.289218 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5","Type":"ContainerStarted","Data":"dd70a0c75c6ceb1525741d07ad63e4e904398858a7ec2c9fcc9ceac6735adb48"} Jul 07 18:52:42.289480 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:42.289254 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e2b89ac-39d2-4c4b-8a6c-34170ca76db5","Type":"ContainerStarted","Data":"a7db8cfa1e5a6be3a74f46c1049f7ba3e4f9d8678b8894c24feaa4a39dfb4f94"} Jul 07 18:52:42.319659 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:42.319596 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.303662434 podStartE2EDuration="2.319580382s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.917948ms" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:42.317192385 +0000 UTC m=+170.376640147" watchObservedRunningTime="2026-07-07 18:52:42.319580382 +0000 UTC m=+170.379028132" Jul 07 18:52:46.071677 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.071576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:46.131289 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.131260 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:46.257764 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.257734 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74868f4888-hshmt"] Jul 07 18:52:46.260385 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.260348 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.263157 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.262999 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 18:52:46.263254 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.263194 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 18:52:46.263592 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.263570 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 18:52:46.263697 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.263610 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 18:52:46.263761 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.263574 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 18:52:46.263923 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.263904 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zh69j\"" Jul 07 18:52:46.271755 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.271733 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 18:52:46.276262 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.276240 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74868f4888-hshmt"] Jul 07 18:52:46.324976 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.324909 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:46.359183 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.359153 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-oauth-serving-cert\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.359282 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.359187 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-trusted-ca-bundle\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.359282 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.359219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-serving-cert\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.359392 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.359290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-console-config\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.359432 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.359394 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-oauth-config\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.359432 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.359425 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbsw5\" (UniqueName: \"kubernetes.io/projected/45510bf1-5dcd-4707-92b0-2337ea078371-kube-api-access-bbsw5\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.359509 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.359457 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-service-ca\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.425715 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.425687 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:46.460781 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.460760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-console-config\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.460858 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.460802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-oauth-config\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.460858 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.460824 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbsw5\" (UniqueName: \"kubernetes.io/projected/45510bf1-5dcd-4707-92b0-2337ea078371-kube-api-access-bbsw5\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.461024 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.461007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-service-ca\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.461098 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.461081 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-oauth-serving-cert\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.461147 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.461112 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-trusted-ca-bundle\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.461201 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.461151 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-serving-cert\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.461678 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.461653 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-console-config\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.461787 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.461710 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-service-ca\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.461787 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.461745 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-oauth-serving-cert\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.462022 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.461997 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-trusted-ca-bundle\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.463228 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.463207 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-oauth-config\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.463584 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.463564 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-serving-cert\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.680272 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.680242 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbsw5\" (UniqueName: \"kubernetes.io/projected/45510bf1-5dcd-4707-92b0-2337ea078371-kube-api-access-bbsw5\") pod \"console-74868f4888-hshmt\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:46.738721 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.738679 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:46.874183 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:46.874154 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:47.000692 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:47.000599 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74868f4888-hshmt"] Jul 07 18:52:47.003341 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:52:47.003312 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45510bf1_5dcd_4707_92b0_2337ea078371.slice/crio-fa0abada0da4faa2abf46707fb954348ce2ee316f647d526a15320817aa2f6a6 WatchSource:0}: Error finding container fa0abada0da4faa2abf46707fb954348ce2ee316f647d526a15320817aa2f6a6: Status 404 returned error can't find the container with id fa0abada0da4faa2abf46707fb954348ce2ee316f647d526a15320817aa2f6a6 Jul 07 18:52:47.073736 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:47.073694 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:47.171677 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:47.171640 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:47.308250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:47.308167 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74868f4888-hshmt" event={"ID":"45510bf1-5dcd-4707-92b0-2337ea078371","Type":"ContainerStarted","Data":"747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11"} Jul 07 18:52:47.308250 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:47.308221 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74868f4888-hshmt" event={"ID":"45510bf1-5dcd-4707-92b0-2337ea078371","Type":"ContainerStarted","Data":"fa0abada0da4faa2abf46707fb954348ce2ee316f647d526a15320817aa2f6a6"} Jul 07 18:52:47.333653 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:47.333606 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74868f4888-hshmt" podStartSLOduration=1.333592423 podStartE2EDuration="1.333592423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:47.331997309 +0000 UTC m=+175.391445063" watchObservedRunningTime="2026-07-07 18:52:47.333592423 +0000 UTC m=+175.393040174" Jul 07 18:52:52.594519 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:52.594437 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:52.695369 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:52.695323 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:56.874642 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:56.874612 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:56.875085 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:56.874666 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:56.879429 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:56.879408 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:57.350807 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:57.350731 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:52:57.520743 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:57.520709 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:57.619219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:57.619186 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:52:57.675336 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:52:57.675308 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:16.528784 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:16.528750 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:16.629498 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:16.629465 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:25.329812 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:25.329772 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:25.426952 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:25.426920 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:45.156976 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:45.156940 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:45.413706 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:45.413614 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:46.939111 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:46.939067 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:47.898494 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:47.898458 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:50.575573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:50.575517 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:50.677831 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:50.677787 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:54.209064 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:54.209024 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:54.315927 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:54.315895 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:54.553284 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:54.553204 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:54.703467 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:54.703436 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:55.774009 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:55.773977 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:55.857734 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:55.857697 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:56.959222 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:56.959191 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:53:57.149829 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:53:57.149794 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:01.867301 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:01.867263 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:01.960218 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:01.960179 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:04.553710 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:04.553677 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:06.072653 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:06.072607 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:06.168728 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:06.168689 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:07.423612 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.423579 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4"] Jul 07 18:54:07.426048 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.426032 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" Jul 07 18:54:07.428401 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.428381 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 18:54:07.429192 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.429174 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-858zx\"" Jul 07 18:54:07.429301 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.429183 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:54:07.435771 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.435754 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4"] Jul 07 18:54:07.584243 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.584216 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gbwl\" (UniqueName: \"kubernetes.io/projected/9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c-kube-api-access-2gbwl\") pod \"openshift-lws-operator-fd8ccff4c-wz2s4\" (UID: \"9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" Jul 07 18:54:07.584399 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.584259 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wz2s4\" (UID: \"9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" Jul 07 18:54:07.685647 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.685574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gbwl\" (UniqueName: \"kubernetes.io/projected/9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c-kube-api-access-2gbwl\") pod \"openshift-lws-operator-fd8ccff4c-wz2s4\" (UID: \"9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" Jul 07 18:54:07.685647 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.685620 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wz2s4\" (UID: \"9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" Jul 07 18:54:07.685987 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.685970 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wz2s4\" (UID: \"9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" Jul 07 18:54:07.696551 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.696517 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gbwl\" (UniqueName: \"kubernetes.io/projected/9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c-kube-api-access-2gbwl\") pod \"openshift-lws-operator-fd8ccff4c-wz2s4\" (UID: \"9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" Jul 07 18:54:07.734443 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.734418 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" Jul 07 18:54:07.864281 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:07.864231 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4"] Jul 07 18:54:07.866865 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:54:07.866836 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e3b71d5_8a9a_411d_8fa0_7c9d9f6d1b8c.slice/crio-eb08bacce8cd50b92e01a38a80e54a76e092d6e1975c1a258d87a14834b7771d WatchSource:0}: Error finding container eb08bacce8cd50b92e01a38a80e54a76e092d6e1975c1a258d87a14834b7771d: Status 404 returned error can't find the container with id eb08bacce8cd50b92e01a38a80e54a76e092d6e1975c1a258d87a14834b7771d Jul 07 18:54:08.604806 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:08.604772 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" event={"ID":"9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c","Type":"ContainerStarted","Data":"eb08bacce8cd50b92e01a38a80e54a76e092d6e1975c1a258d87a14834b7771d"} Jul 07 18:54:10.614554 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:10.614521 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" event={"ID":"9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c","Type":"ContainerStarted","Data":"2345680fcb50afb4ada48998f0471298d670550ee96166c82723ef0b9a3ac1ce"} Jul 07 18:54:10.640127 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:10.640074 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wz2s4" podStartSLOduration=1.008521545 podStartE2EDuration="3.640057295s" totalImagesPullingTime="2.63153575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:10.639452296 +0000 UTC m=+258.698900046" watchObservedRunningTime="2026-07-07 18:54:10.640057295 +0000 UTC m=+258.699505045" Jul 07 18:54:10.887480 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:10.887447 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:10.980989 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:10.980950 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:11.382111 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:11.382074 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:11.481610 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:11.481580 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:13.559521 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:13.559486 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:23.424616 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:23.424528 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:29.183257 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:29.183212 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:29.291223 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:29.291188 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:29.855399 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:29.855340 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:29.991268 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:29.991226 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:30.290191 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.290099 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:30.393548 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.393515 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:30.439345 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.439310 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf"] Jul 07 18:54:30.447278 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.447252 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.450647 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.450623 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 18:54:30.450750 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.450644 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q8s9r\"" Jul 07 18:54:30.450750 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.450632 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 18:54:30.450939 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.450918 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 18:54:30.451126 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.451109 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 18:54:30.460277 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.460257 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf"] Jul 07 18:54:30.463766 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.463741 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/341f2d94-e418-4e55-acb9-486db24453eb-manifests\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.463859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.463800 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/341f2d94-e418-4e55-acb9-486db24453eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.463859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.463825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/341f2d94-e418-4e55-acb9-486db24453eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.463935 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.463861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/341f2d94-e418-4e55-acb9-486db24453eb-tmp\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.463969 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.463961 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrxj\" (UniqueName: \"kubernetes.io/projected/341f2d94-e418-4e55-acb9-486db24453eb-kube-api-access-wtrxj\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.564932 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.564853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/341f2d94-e418-4e55-acb9-486db24453eb-tmp\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.564932 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.564902 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrxj\" (UniqueName: \"kubernetes.io/projected/341f2d94-e418-4e55-acb9-486db24453eb-kube-api-access-wtrxj\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.564932 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.564934 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/341f2d94-e418-4e55-acb9-486db24453eb-manifests\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.565211 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.564956 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/341f2d94-e418-4e55-acb9-486db24453eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.565211 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.564981 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/341f2d94-e418-4e55-acb9-486db24453eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.565408 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.565384 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/341f2d94-e418-4e55-acb9-486db24453eb-manifests\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.567293 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.567268 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/341f2d94-e418-4e55-acb9-486db24453eb-tmp\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.567400 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.567331 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/341f2d94-e418-4e55-acb9-486db24453eb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.567473 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.567454 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/341f2d94-e418-4e55-acb9-486db24453eb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.594936 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.594912 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrxj\" (UniqueName: \"kubernetes.io/projected/341f2d94-e418-4e55-acb9-486db24453eb-kube-api-access-wtrxj\") pod \"opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf\" (UID: \"341f2d94-e418-4e55-acb9-486db24453eb\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.757012 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.756977 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:30.785534 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.785495 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:30.893777 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.893738 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:30.895090 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.894990 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf"] Jul 07 18:54:30.897835 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:54:30.897808 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341f2d94_e418_4e55_acb9_486db24453eb.slice/crio-e2276357da7e69cba7e1bd4a669778efac209d9af0ee1c704e444fe7b56cd079 WatchSource:0}: Error finding container e2276357da7e69cba7e1bd4a669778efac209d9af0ee1c704e444fe7b56cd079: Status 404 returned error can't find the container with id e2276357da7e69cba7e1bd4a669778efac209d9af0ee1c704e444fe7b56cd079 Jul 07 18:54:30.994782 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:30.994743 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:31.091234 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:31.091149 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:31.195126 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:31.195090 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:31.330495 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:31.330465 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:31.451044 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:31.451007 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:31.698062 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:31.697952 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" event={"ID":"341f2d94-e418-4e55-acb9-486db24453eb","Type":"ContainerStarted","Data":"e2276357da7e69cba7e1bd4a669778efac209d9af0ee1c704e444fe7b56cd079"} Jul 07 18:54:33.087056 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:33.087019 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:34.712476 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:34.712440 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" event={"ID":"341f2d94-e418-4e55-acb9-486db24453eb","Type":"ContainerStarted","Data":"1ee949f3581d1c2c81fc3fd344f78aa849d15778ea729709fb54121e67812047"} Jul 07 18:54:35.718417 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:35.718383 2582 generic.go:356] "Generic (PLEG): container finished" podID="341f2d94-e418-4e55-acb9-486db24453eb" containerID="1ee949f3581d1c2c81fc3fd344f78aa849d15778ea729709fb54121e67812047" exitCode=0 Jul 07 18:54:35.718863 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:35.718478 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" event={"ID":"341f2d94-e418-4e55-acb9-486db24453eb","Type":"ContainerDied","Data":"1ee949f3581d1c2c81fc3fd344f78aa849d15778ea729709fb54121e67812047"} Jul 07 18:54:36.723992 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:36.723956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" event={"ID":"341f2d94-e418-4e55-acb9-486db24453eb","Type":"ContainerStarted","Data":"e57e0b5876deaa13c9fc499fe3d4ede190ea59342ab3578e9d82eb1bbc967238"} Jul 07 18:54:36.724412 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:36.724200 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:36.753052 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:36.752990 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" podStartSLOduration=2.157079613 podStartE2EDuration="6.752967094s" totalImagesPullingTime="3.507139086s" totalInitContainerRuntime="1.088748395s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:36.750203794 +0000 UTC m=+284.809651537" watchObservedRunningTime="2026-07-07 18:54:36.752967094 +0000 UTC m=+284.812414846" Jul 07 18:54:42.415169 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:42.415132 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:42.515712 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:42.515681 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:47.730054 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:47.730020 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf" Jul 07 18:54:49.727910 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:49.727855 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:50.377494 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.377462 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb"] Jul 07 18:54:50.380716 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.380696 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:50.383460 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.383436 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 18:54:50.383934 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.383917 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 18:54:50.384181 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.384166 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nr7vx\"" Jul 07 18:54:50.406931 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.406905 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb"] Jul 07 18:54:50.536531 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.536493 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftpwz\" (UniqueName: \"kubernetes.io/projected/4215c973-8f45-40dc-9470-dd0e573e956f-kube-api-access-ftpwz\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:50.536698 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.536568 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4215c973-8f45-40dc-9470-dd0e573e956f-tmp\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:50.536698 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.536626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4215c973-8f45-40dc-9470-dd0e573e956f-tls-certs\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:50.550711 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.550676 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-b6j28"] Jul 07 18:54:50.554408 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.554385 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:50.560231 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.560205 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 18:54:50.560593 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.560283 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-sg4sq\"" Jul 07 18:54:50.576015 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.575987 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-b6j28"] Jul 07 18:54:50.638076 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.637974 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftpwz\" (UniqueName: \"kubernetes.io/projected/4215c973-8f45-40dc-9470-dd0e573e956f-kube-api-access-ftpwz\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:50.638076 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.638058 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4215c973-8f45-40dc-9470-dd0e573e956f-tmp\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:50.638312 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.638080 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz596\" (UniqueName: \"kubernetes.io/projected/67f592e6-29e6-4cc9-8616-8a29a9fad7e1-kube-api-access-hz596\") pod \"odh-model-controller-7998c67dc4-b6j28\" (UID: \"67f592e6-29e6-4cc9-8616-8a29a9fad7e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:50.638312 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.638130 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67f592e6-29e6-4cc9-8616-8a29a9fad7e1-cert\") pod \"odh-model-controller-7998c67dc4-b6j28\" (UID: \"67f592e6-29e6-4cc9-8616-8a29a9fad7e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:50.638312 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.638160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4215c973-8f45-40dc-9470-dd0e573e956f-tls-certs\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:50.638603 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:54:50.638579 2582 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 07 18:54:50.638687 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:54:50.638658 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4215c973-8f45-40dc-9470-dd0e573e956f-tls-certs podName:4215c973-8f45-40dc-9470-dd0e573e956f nodeName:}" failed. No retries permitted until 2026-07-07 18:54:51.138636454 +0000 UTC m=+299.198084193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4215c973-8f45-40dc-9470-dd0e573e956f-tls-certs") pod "kube-auth-proxy-85b6b9f996-ktfxb" (UID: "4215c973-8f45-40dc-9470-dd0e573e956f") : secret "kube-auth-proxy-tls" not found Jul 07 18:54:50.640724 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.640695 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4215c973-8f45-40dc-9470-dd0e573e956f-tmp\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:50.663394 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.663350 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftpwz\" (UniqueName: \"kubernetes.io/projected/4215c973-8f45-40dc-9470-dd0e573e956f-kube-api-access-ftpwz\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:50.739184 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.739142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz596\" (UniqueName: \"kubernetes.io/projected/67f592e6-29e6-4cc9-8616-8a29a9fad7e1-kube-api-access-hz596\") pod \"odh-model-controller-7998c67dc4-b6j28\" (UID: \"67f592e6-29e6-4cc9-8616-8a29a9fad7e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:50.739652 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.739199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67f592e6-29e6-4cc9-8616-8a29a9fad7e1-cert\") pod \"odh-model-controller-7998c67dc4-b6j28\" (UID: \"67f592e6-29e6-4cc9-8616-8a29a9fad7e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:50.739652 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:54:50.739330 2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 07 18:54:50.739652 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:54:50.739404 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67f592e6-29e6-4cc9-8616-8a29a9fad7e1-cert podName:67f592e6-29e6-4cc9-8616-8a29a9fad7e1 nodeName:}" failed. No retries permitted until 2026-07-07 18:54:51.239386394 +0000 UTC m=+299.298834131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/67f592e6-29e6-4cc9-8616-8a29a9fad7e1-cert") pod "odh-model-controller-7998c67dc4-b6j28" (UID: "67f592e6-29e6-4cc9-8616-8a29a9fad7e1") : secret "odh-model-controller-webhook-cert" not found Jul 07 18:54:50.751512 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:50.751488 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz596\" (UniqueName: \"kubernetes.io/projected/67f592e6-29e6-4cc9-8616-8a29a9fad7e1-kube-api-access-hz596\") pod \"odh-model-controller-7998c67dc4-b6j28\" (UID: \"67f592e6-29e6-4cc9-8616-8a29a9fad7e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:51.052292 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.052202 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:51.143501 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.143462 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4215c973-8f45-40dc-9470-dd0e573e956f-tls-certs\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:51.145918 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.145892 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4215c973-8f45-40dc-9470-dd0e573e956f-tls-certs\") pod \"kube-auth-proxy-85b6b9f996-ktfxb\" (UID: \"4215c973-8f45-40dc-9470-dd0e573e956f\") " pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:51.244239 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.244201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67f592e6-29e6-4cc9-8616-8a29a9fad7e1-cert\") pod \"odh-model-controller-7998c67dc4-b6j28\" (UID: \"67f592e6-29e6-4cc9-8616-8a29a9fad7e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:51.246741 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.246711 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67f592e6-29e6-4cc9-8616-8a29a9fad7e1-cert\") pod \"odh-model-controller-7998c67dc4-b6j28\" (UID: \"67f592e6-29e6-4cc9-8616-8a29a9fad7e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:51.291414 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.291385 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" Jul 07 18:54:51.439380 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:54:51.439329 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4215c973_8f45_40dc_9470_dd0e573e956f.slice/crio-697bae6e0c26701e13dcb73e23229dfdcde41ae5718baf6d24e23f40ad714010 WatchSource:0}: Error finding container 697bae6e0c26701e13dcb73e23229dfdcde41ae5718baf6d24e23f40ad714010: Status 404 returned error can't find the container with id 697bae6e0c26701e13dcb73e23229dfdcde41ae5718baf6d24e23f40ad714010 Jul 07 18:54:51.439520 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.439498 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb"] Jul 07 18:54:51.464393 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.464334 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:51.618822 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.618791 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-b6j28"] Jul 07 18:54:51.621797 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:54:51.621773 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f592e6_29e6_4cc9_8616_8a29a9fad7e1.slice/crio-2291cfd60f325267c9387352179078b98265aefd1ff4844bdd47a240bfbc225d WatchSource:0}: Error finding container 2291cfd60f325267c9387352179078b98265aefd1ff4844bdd47a240bfbc225d: Status 404 returned error can't find the container with id 2291cfd60f325267c9387352179078b98265aefd1ff4844bdd47a240bfbc225d Jul 07 18:54:51.788282 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.788247 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" event={"ID":"4215c973-8f45-40dc-9470-dd0e573e956f","Type":"ContainerStarted","Data":"697bae6e0c26701e13dcb73e23229dfdcde41ae5718baf6d24e23f40ad714010"} Jul 07 18:54:51.789516 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.789473 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" event={"ID":"67f592e6-29e6-4cc9-8616-8a29a9fad7e1","Type":"ContainerStarted","Data":"2291cfd60f325267c9387352179078b98265aefd1ff4844bdd47a240bfbc225d"} Jul 07 18:54:51.850556 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.850514 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:51.892019 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.891946 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nlv9v"] Jul 07 18:54:51.896326 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.896305 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:54:51.905679 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.905651 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 18:54:51.905820 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.905679 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jn4tg\"" Jul 07 18:54:51.913772 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:51.913747 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nlv9v"] Jul 07 18:54:52.051785 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.051748 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr6b9\" (UniqueName: \"kubernetes.io/projected/f7c00999-8a91-49bd-b7f4-3517ab2ac8b5-kube-api-access-pr6b9\") pod \"model-serving-api-54d89bd5fc-nlv9v\" (UID: \"f7c00999-8a91-49bd-b7f4-3517ab2ac8b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:54:52.051949 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.051799 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c00999-8a91-49bd-b7f4-3517ab2ac8b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-nlv9v\" (UID: \"f7c00999-8a91-49bd-b7f4-3517ab2ac8b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:54:52.129949 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.129900 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:52.153222 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.152913 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr6b9\" (UniqueName: \"kubernetes.io/projected/f7c00999-8a91-49bd-b7f4-3517ab2ac8b5-kube-api-access-pr6b9\") pod \"model-serving-api-54d89bd5fc-nlv9v\" (UID: \"f7c00999-8a91-49bd-b7f4-3517ab2ac8b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:54:52.153222 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.152981 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c00999-8a91-49bd-b7f4-3517ab2ac8b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-nlv9v\" (UID: \"f7c00999-8a91-49bd-b7f4-3517ab2ac8b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:54:52.156160 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.156130 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c00999-8a91-49bd-b7f4-3517ab2ac8b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-nlv9v\" (UID: \"f7c00999-8a91-49bd-b7f4-3517ab2ac8b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:54:52.166085 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.166032 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr6b9\" (UniqueName: \"kubernetes.io/projected/f7c00999-8a91-49bd-b7f4-3517ab2ac8b5-kube-api-access-pr6b9\") pod \"model-serving-api-54d89bd5fc-nlv9v\" (UID: \"f7c00999-8a91-49bd-b7f4-3517ab2ac8b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:54:52.211045 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.210998 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl"] Jul 07 18:54:52.214858 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.214830 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.215294 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.215151 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:54:52.222300 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.221838 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 18:54:52.222300 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.222084 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xrpc2\"" Jul 07 18:54:52.222300 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.222105 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 18:54:52.222547 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.222407 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 18:54:52.223218 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.222687 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 18:54:52.244812 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.244570 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl"] Jul 07 18:54:52.249378 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.245767 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:52.354485 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.354453 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:52.355114 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.355078 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.355254 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.355142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-cacerts\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.355254 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.355180 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-token\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.356068 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.356040 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.356175 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.356082 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bj2q\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-kube-api-access-7bj2q\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.356175 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.356117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe30296-86d1-430c-b781-6ef1717bb2fa-local-certs\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.356175 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.356144 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.385180 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.385157 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 18:54:52.386109 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.385902 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 18:54:52.402539 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.402521 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 18:54:52.414523 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.412609 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nlv9v"] Jul 07 18:54:52.416960 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:54:52.416933 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c00999_8a91_49bd_b7f4_3517ab2ac8b5.slice/crio-7ab31bd3d75559f91a3434b4235d1ab117315c0a8783fe7f512d0923617b2cf4 WatchSource:0}: Error finding container 7ab31bd3d75559f91a3434b4235d1ab117315c0a8783fe7f512d0923617b2cf4: Status 404 returned error can't find the container with id 7ab31bd3d75559f91a3434b4235d1ab117315c0a8783fe7f512d0923617b2cf4 Jul 07 18:54:52.456712 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.456675 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.456892 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.456722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bj2q\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-kube-api-access-7bj2q\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.456892 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.456753 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe30296-86d1-430c-b781-6ef1717bb2fa-local-certs\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.456892 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.456782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.456892 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.456813 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.456892 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.456856 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-cacerts\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.456892 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.456893 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-token\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.459666 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.459638 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 18:54:52.459851 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.459820 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 18:54:52.459913 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.459854 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 18:54:52.460991 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.460968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe30296-86d1-430c-b781-6ef1717bb2fa-local-certs\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.462714 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.462693 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 18:54:52.467944 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.467898 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.469110 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.469060 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-token\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.472155 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.472127 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bj2q\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-kube-api-access-7bj2q\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.474065 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.474039 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.476151 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.476113 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.477732 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.477708 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-cacerts\") pod \"istiod-openshift-gateway-7574459656-dj7xl\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.559952 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.559714 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xrpc2\"" Jul 07 18:54:52.584863 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.567991 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:52.761563 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.761465 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl"] Jul 07 18:54:52.768580 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:54:52.768550 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe30296_86d1_430c_b781_6ef1717bb2fa.slice/crio-ec69b9b7b8d6c1c0aeca5d3d5a92d0128f292fb825e27e9d4d57c165c2fcfe02 WatchSource:0}: Error finding container ec69b9b7b8d6c1c0aeca5d3d5a92d0128f292fb825e27e9d4d57c165c2fcfe02: Status 404 returned error can't find the container with id ec69b9b7b8d6c1c0aeca5d3d5a92d0128f292fb825e27e9d4d57c165c2fcfe02 Jul 07 18:54:52.797963 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.797927 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" event={"ID":"dbe30296-86d1-430c-b781-6ef1717bb2fa","Type":"ContainerStarted","Data":"ec69b9b7b8d6c1c0aeca5d3d5a92d0128f292fb825e27e9d4d57c165c2fcfe02"} Jul 07 18:54:52.800170 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:52.800134 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" event={"ID":"f7c00999-8a91-49bd-b7f4-3517ab2ac8b5","Type":"ContainerStarted","Data":"7ab31bd3d75559f91a3434b4235d1ab117315c0a8783fe7f512d0923617b2cf4"} Jul 07 18:54:53.681963 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:53.681903 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:56.993844 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:56.993817 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 18:54:57.060632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.060583 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:54:57.060748 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.060671 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:54:57.831498 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.831465 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" event={"ID":"f7c00999-8a91-49bd-b7f4-3517ab2ac8b5","Type":"ContainerStarted","Data":"566563ee4ba10254430b83b57b3e842683838c7d9f8447073ee3ac98b420132d"} Jul 07 18:54:57.831708 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.831586 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:54:57.833217 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.833187 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" event={"ID":"67f592e6-29e6-4cc9-8616-8a29a9fad7e1","Type":"ContainerStarted","Data":"da2b44b8b9fa932f3c528d33952e643feb13311fbb1141642ff185b887f5fe41"} Jul 07 18:54:57.833345 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.833248 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:54:57.835860 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.835837 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" event={"ID":"4215c973-8f45-40dc-9470-dd0e573e956f","Type":"ContainerStarted","Data":"ba7bfa20fd8e9f43ea1a88c6a060503957937f4fbf47518a83ac6bf0908f1055"} Jul 07 18:54:57.837586 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.837563 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" event={"ID":"dbe30296-86d1-430c-b781-6ef1717bb2fa","Type":"ContainerStarted","Data":"053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda"} Jul 07 18:54:57.837688 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.837677 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:54:57.863404 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.863329 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" podStartSLOduration=2.287686907 podStartE2EDuration="6.86331056s" totalImagesPullingTime="4.575623653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:57.862842627 +0000 UTC m=+305.922290378" watchObservedRunningTime="2026-07-07 18:54:57.86331056 +0000 UTC m=+305.922758312" Jul 07 18:54:57.882979 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.882923 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85b6b9f996-ktfxb" podStartSLOduration=2.332707716 podStartE2EDuration="7.882905467s" totalImagesPullingTime="5.550197751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:57.881791431 +0000 UTC m=+305.941239181" watchObservedRunningTime="2026-07-07 18:54:57.882905467 +0000 UTC m=+305.942353223" Jul 07 18:54:57.901334 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.901266 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" podStartSLOduration=2.532945908 podStartE2EDuration="7.901251941s" totalImagesPullingTime="5.368306033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:57.900578663 +0000 UTC m=+305.960026426" watchObservedRunningTime="2026-07-07 18:54:57.901251941 +0000 UTC m=+305.960699691" Jul 07 18:54:57.925040 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:57.924988 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" podStartSLOduration=1.636798041 podStartE2EDuration="5.924966564s" totalImagesPullingTime="4.288168523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:57.923468695 +0000 UTC m=+305.982916445" watchObservedRunningTime="2026-07-07 18:54:57.924966564 +0000 UTC m=+305.984414318" Jul 07 18:54:58.230553 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:58.230515 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:58.327152 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:58.327114 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:58.843425 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:58.843393 2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-dj7xl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 18:54:58.843591 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:58.843445 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" podUID="dbe30296-86d1-430c-b781-6ef1717bb2fa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 18:54:59.031530 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:59.031498 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:59.209666 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:59.209629 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:54:59.364097 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:54:59.364058 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:01.843052 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:01.843017 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:55:02.409657 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.409620 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:02.481626 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.481591 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt"] Jul 07 18:55:02.485629 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.485608 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:02.489871 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.489850 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 18:55:02.490280 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.490259 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fccd8\"" Jul 07 18:55:02.492856 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.492837 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl"] Jul 07 18:55:02.496462 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.496443 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:02.498643 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.498622 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt"] Jul 07 18:55:02.499066 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.499021 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 18:55:02.499179 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.499137 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2fvg5\"" Jul 07 18:55:02.518883 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.518856 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl"] Jul 07 18:55:02.524311 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.524289 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:02.614323 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.614290 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:02.659092 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.659057 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/006722ab-44d9-4c99-bb99-ee336d4d2932-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ls8tl\" (UID: \"006722ab-44d9-4c99-bb99-ee336d4d2932\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:02.659246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.659102 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83e23d62-c388-4dc1-a1ae-e2e6940b5dbd-cert\") pod \"kserve-controller-manager-d6f4b65b8-m7dnt\" (UID: \"83e23d62-c388-4dc1-a1ae-e2e6940b5dbd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:02.659246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.659154 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d96h9\" (UniqueName: \"kubernetes.io/projected/83e23d62-c388-4dc1-a1ae-e2e6940b5dbd-kube-api-access-d96h9\") pod \"kserve-controller-manager-d6f4b65b8-m7dnt\" (UID: \"83e23d62-c388-4dc1-a1ae-e2e6940b5dbd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:02.659246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.659222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-692rw\" (UniqueName: \"kubernetes.io/projected/006722ab-44d9-4c99-bb99-ee336d4d2932-kube-api-access-692rw\") pod \"llmisvc-controller-manager-777c6bd7d5-ls8tl\" (UID: \"006722ab-44d9-4c99-bb99-ee336d4d2932\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:02.731102 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.731009 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:02.760192 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.760163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-692rw\" (UniqueName: \"kubernetes.io/projected/006722ab-44d9-4c99-bb99-ee336d4d2932-kube-api-access-692rw\") pod \"llmisvc-controller-manager-777c6bd7d5-ls8tl\" (UID: \"006722ab-44d9-4c99-bb99-ee336d4d2932\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:02.760379 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.760222 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/006722ab-44d9-4c99-bb99-ee336d4d2932-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ls8tl\" (UID: \"006722ab-44d9-4c99-bb99-ee336d4d2932\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:02.760379 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.760259 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83e23d62-c388-4dc1-a1ae-e2e6940b5dbd-cert\") pod \"kserve-controller-manager-d6f4b65b8-m7dnt\" (UID: \"83e23d62-c388-4dc1-a1ae-e2e6940b5dbd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:02.760379 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.760299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d96h9\" (UniqueName: \"kubernetes.io/projected/83e23d62-c388-4dc1-a1ae-e2e6940b5dbd-kube-api-access-d96h9\") pod \"kserve-controller-manager-d6f4b65b8-m7dnt\" (UID: \"83e23d62-c388-4dc1-a1ae-e2e6940b5dbd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:02.762949 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.762915 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83e23d62-c388-4dc1-a1ae-e2e6940b5dbd-cert\") pod \"kserve-controller-manager-d6f4b65b8-m7dnt\" (UID: \"83e23d62-c388-4dc1-a1ae-e2e6940b5dbd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:02.763056 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.762915 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/006722ab-44d9-4c99-bb99-ee336d4d2932-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ls8tl\" (UID: \"006722ab-44d9-4c99-bb99-ee336d4d2932\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:02.780004 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.779945 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-692rw\" (UniqueName: \"kubernetes.io/projected/006722ab-44d9-4c99-bb99-ee336d4d2932-kube-api-access-692rw\") pod \"llmisvc-controller-manager-777c6bd7d5-ls8tl\" (UID: \"006722ab-44d9-4c99-bb99-ee336d4d2932\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:02.780112 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.780101 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d96h9\" (UniqueName: \"kubernetes.io/projected/83e23d62-c388-4dc1-a1ae-e2e6940b5dbd-kube-api-access-d96h9\") pod \"kserve-controller-manager-d6f4b65b8-m7dnt\" (UID: \"83e23d62-c388-4dc1-a1ae-e2e6940b5dbd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:02.799067 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.799038 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:02.810032 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.809990 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:02.853635 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.853606 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:02.956455 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.956424 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt"] Jul 07 18:55:02.958160 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:55:02.958131 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e23d62_c388_4dc1_a1ae_e2e6940b5dbd.slice/crio-568bd1f46e729248aa6e5c2188fe77888b7b3c48cf879a7a88a8d06af0792b50 WatchSource:0}: Error finding container 568bd1f46e729248aa6e5c2188fe77888b7b3c48cf879a7a88a8d06af0792b50: Status 404 returned error can't find the container with id 568bd1f46e729248aa6e5c2188fe77888b7b3c48cf879a7a88a8d06af0792b50 Jul 07 18:55:02.959552 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.959530 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:55:02.977583 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.977460 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:02.979157 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:02.979079 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl"] Jul 07 18:55:02.981631 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:55:02.981575 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod006722ab_44d9_4c99_bb99_ee336d4d2932.slice/crio-46d1f5b5db9a466900728accfd3ba3957ffbfd284ceec99790d29eb691306644 WatchSource:0}: Error finding container 46d1f5b5db9a466900728accfd3ba3957ffbfd284ceec99790d29eb691306644: Status 404 returned error can't find the container with id 46d1f5b5db9a466900728accfd3ba3957ffbfd284ceec99790d29eb691306644 Jul 07 18:55:03.879495 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:03.879443 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" event={"ID":"83e23d62-c388-4dc1-a1ae-e2e6940b5dbd","Type":"ContainerStarted","Data":"568bd1f46e729248aa6e5c2188fe77888b7b3c48cf879a7a88a8d06af0792b50"} Jul 07 18:55:03.880793 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:03.880760 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" event={"ID":"006722ab-44d9-4c99-bb99-ee336d4d2932","Type":"ContainerStarted","Data":"46d1f5b5db9a466900728accfd3ba3957ffbfd284ceec99790d29eb691306644"} Jul 07 18:55:06.232435 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.232393 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl"] Jul 07 18:55:06.232915 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.232635 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" podUID="dbe30296-86d1-430c-b781-6ef1717bb2fa" containerName="discovery" containerID="cri-o://053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda" gracePeriod=30 Jul 07 18:55:06.652421 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.652397 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:55:06.697285 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.697253 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-cacerts\") pod \"dbe30296-86d1-430c-b781-6ef1717bb2fa\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " Jul 07 18:55:06.697478 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.697303 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bj2q\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-kube-api-access-7bj2q\") pod \"dbe30296-86d1-430c-b781-6ef1717bb2fa\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " Jul 07 18:55:06.697478 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.697328 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe30296-86d1-430c-b781-6ef1717bb2fa-local-certs\") pod \"dbe30296-86d1-430c-b781-6ef1717bb2fa\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " Jul 07 18:55:06.697478 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.697425 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-dns-cert\") pod \"dbe30296-86d1-430c-b781-6ef1717bb2fa\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " Jul 07 18:55:06.697651 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.697501 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-kubeconfig\") pod \"dbe30296-86d1-430c-b781-6ef1717bb2fa\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " Jul 07 18:55:06.697651 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.697556 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-ca-configmap\") pod \"dbe30296-86d1-430c-b781-6ef1717bb2fa\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " Jul 07 18:55:06.697651 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.697600 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-token\") pod \"dbe30296-86d1-430c-b781-6ef1717bb2fa\" (UID: \"dbe30296-86d1-430c-b781-6ef1717bb2fa\") " Jul 07 18:55:06.698189 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.698084 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "dbe30296-86d1-430c-b781-6ef1717bb2fa" (UID: "dbe30296-86d1-430c-b781-6ef1717bb2fa"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:55:06.700198 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.700167 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-cacerts" (OuterVolumeSpecName: "cacerts") pod "dbe30296-86d1-430c-b781-6ef1717bb2fa" (UID: "dbe30296-86d1-430c-b781-6ef1717bb2fa"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:55:06.700198 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.700177 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-kube-api-access-7bj2q" (OuterVolumeSpecName: "kube-api-access-7bj2q") pod "dbe30296-86d1-430c-b781-6ef1717bb2fa" (UID: "dbe30296-86d1-430c-b781-6ef1717bb2fa"). InnerVolumeSpecName "kube-api-access-7bj2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:55:06.700424 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.700240 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe30296-86d1-430c-b781-6ef1717bb2fa-local-certs" (OuterVolumeSpecName: "local-certs") pod "dbe30296-86d1-430c-b781-6ef1717bb2fa" (UID: "dbe30296-86d1-430c-b781-6ef1717bb2fa"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:55:06.700424 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.700294 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "dbe30296-86d1-430c-b781-6ef1717bb2fa" (UID: "dbe30296-86d1-430c-b781-6ef1717bb2fa"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:55:06.700424 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.700311 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "dbe30296-86d1-430c-b781-6ef1717bb2fa" (UID: "dbe30296-86d1-430c-b781-6ef1717bb2fa"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:55:06.700580 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.700466 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbe30296-86d1-430c-b781-6ef1717bb2fa" (UID: "dbe30296-86d1-430c-b781-6ef1717bb2fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:55:06.799214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.799122 2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-ca-configmap\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:55:06.799214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.799160 2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-token\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:55:06.799214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.799176 2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-cacerts\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:55:06.799214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.799189 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bj2q\" (UniqueName: \"kubernetes.io/projected/dbe30296-86d1-430c-b781-6ef1717bb2fa-kube-api-access-7bj2q\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:55:06.799214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.799202 2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe30296-86d1-430c-b781-6ef1717bb2fa-local-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:55:06.799214 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.799214 2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-csr-dns-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:55:06.799650 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.799225 2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbe30296-86d1-430c-b781-6ef1717bb2fa-istio-kubeconfig\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:55:06.898372 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.898323 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" event={"ID":"006722ab-44d9-4c99-bb99-ee336d4d2932","Type":"ContainerStarted","Data":"0b83188f1e424f48c9bf36a771f64bbcad615cdcb8a91ab5f3078f4449ffae07"} Jul 07 18:55:06.898554 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.898451 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:06.899611 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.899580 2582 generic.go:356] "Generic (PLEG): container finished" podID="dbe30296-86d1-430c-b781-6ef1717bb2fa" containerID="053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda" exitCode=0 Jul 07 18:55:06.899728 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.899626 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" Jul 07 18:55:06.899728 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.899656 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" event={"ID":"dbe30296-86d1-430c-b781-6ef1717bb2fa","Type":"ContainerDied","Data":"053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda"} Jul 07 18:55:06.899728 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.899701 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl" event={"ID":"dbe30296-86d1-430c-b781-6ef1717bb2fa","Type":"ContainerDied","Data":"ec69b9b7b8d6c1c0aeca5d3d5a92d0128f292fb825e27e9d4d57c165c2fcfe02"} Jul 07 18:55:06.899887 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.899729 2582 scope.go:117] "RemoveContainer" containerID="053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda" Jul 07 18:55:06.901249 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.901229 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" event={"ID":"83e23d62-c388-4dc1-a1ae-e2e6940b5dbd","Type":"ContainerStarted","Data":"a509dbc10923d32b53b08ca31c157a9ba49e5b80d9fec2c3005e63c7dc84a621"} Jul 07 18:55:06.901396 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.901380 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:06.908907 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.908889 2582 scope.go:117] "RemoveContainer" containerID="053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda" Jul 07 18:55:06.909200 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:55:06.909179 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda\": container with ID starting with 053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda not found: ID does not exist" containerID="053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda" Jul 07 18:55:06.909260 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.909207 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda"} err="failed to get container status \"053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda\": rpc error: code = NotFound desc = could not find container \"053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda\": container with ID starting with 053b83a61b10c21a9578ace387df1526ee239d66a2d91d8592108dee1ab7ddda not found: ID does not exist" Jul 07 18:55:06.927039 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.926992 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" podStartSLOduration=1.400679697 podStartE2EDuration="4.926978539s" totalImagesPullingTime="3.526298842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:06.925276706 +0000 UTC m=+314.984724475" watchObservedRunningTime="2026-07-07 18:55:06.926978539 +0000 UTC m=+314.986426289" Jul 07 18:55:06.951187 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.951128 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" podStartSLOduration=1.40754596 podStartE2EDuration="4.951112899s" totalImagesPullingTime="3.543566939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:06.948762253 +0000 UTC m=+315.008210005" watchObservedRunningTime="2026-07-07 18:55:06.951112899 +0000 UTC m=+315.010560649" Jul 07 18:55:06.966764 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.966729 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl"] Jul 07 18:55:06.971648 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:06.971622 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dj7xl"] Jul 07 18:55:08.533121 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:08.533084 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe30296-86d1-430c-b781-6ef1717bb2fa" path="/var/lib/kubelet/pods/dbe30296-86d1-430c-b781-6ef1717bb2fa/volumes" Jul 07 18:55:08.844157 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:08.844075 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-b6j28" Jul 07 18:55:08.845870 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:08.845849 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-nlv9v" Jul 07 18:55:37.913185 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:37.913139 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ls8tl" Jul 07 18:55:37.917151 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:37.917114 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-m7dnt" Jul 07 18:55:51.205869 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.205828 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:51.303485 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.303443 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:51.342146 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.342113 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nd4j4"] Jul 07 18:55:51.342490 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.342477 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe30296-86d1-430c-b781-6ef1717bb2fa" containerName="discovery" Jul 07 18:55:51.342540 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.342492 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe30296-86d1-430c-b781-6ef1717bb2fa" containerName="discovery" Jul 07 18:55:51.342574 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.342547 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe30296-86d1-430c-b781-6ef1717bb2fa" containerName="discovery" Jul 07 18:55:51.344425 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.344408 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" Jul 07 18:55:51.346641 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.346620 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 18:55:51.347524 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.347508 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 18:55:51.347621 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.347511 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-s2d7m\"" Jul 07 18:55:51.357169 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.357145 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nd4j4"] Jul 07 18:55:51.394674 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.394650 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:51.458510 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.458451 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzj5w\" (UniqueName: \"kubernetes.io/projected/cb2b84a6-06a3-4a22-9153-31c001d46380-kube-api-access-lzj5w\") pod \"kuadrant-operator-catalog-nd4j4\" (UID: \"cb2b84a6-06a3-4a22-9153-31c001d46380\") " pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" Jul 07 18:55:51.559553 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.559526 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzj5w\" (UniqueName: \"kubernetes.io/projected/cb2b84a6-06a3-4a22-9153-31c001d46380-kube-api-access-lzj5w\") pod \"kuadrant-operator-catalog-nd4j4\" (UID: \"cb2b84a6-06a3-4a22-9153-31c001d46380\") " pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" Jul 07 18:55:51.568813 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.568788 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzj5w\" (UniqueName: \"kubernetes.io/projected/cb2b84a6-06a3-4a22-9153-31c001d46380-kube-api-access-lzj5w\") pod \"kuadrant-operator-catalog-nd4j4\" (UID: \"cb2b84a6-06a3-4a22-9153-31c001d46380\") " pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" Jul 07 18:55:51.654824 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.654801 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" Jul 07 18:55:51.699371 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.699323 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nd4j4"] Jul 07 18:55:51.802525 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.802494 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nd4j4"] Jul 07 18:55:51.805831 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:55:51.805804 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2b84a6_06a3_4a22_9153_31c001d46380.slice/crio-964322f86e9b0c6909997e52f1b25dfa7402ed960403a65de9d9640210b71f98 WatchSource:0}: Error finding container 964322f86e9b0c6909997e52f1b25dfa7402ed960403a65de9d9640210b71f98: Status 404 returned error can't find the container with id 964322f86e9b0c6909997e52f1b25dfa7402ed960403a65de9d9640210b71f98 Jul 07 18:55:51.909246 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.909223 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k8sld"] Jul 07 18:55:51.912260 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.912243 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k8sld" Jul 07 18:55:51.921907 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:51.921884 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k8sld"] Jul 07 18:55:52.063341 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:52.063264 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86kp\" (UniqueName: \"kubernetes.io/projected/a610e725-a70a-4795-984b-c9576b96ad8a-kube-api-access-c86kp\") pod \"kuadrant-operator-catalog-k8sld\" (UID: \"a610e725-a70a-4795-984b-c9576b96ad8a\") " pod="kuadrant-system/kuadrant-operator-catalog-k8sld" Jul 07 18:55:52.107748 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:52.107721 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" event={"ID":"cb2b84a6-06a3-4a22-9153-31c001d46380","Type":"ContainerStarted","Data":"964322f86e9b0c6909997e52f1b25dfa7402ed960403a65de9d9640210b71f98"} Jul 07 18:55:52.139854 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:52.139812 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:52.164343 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:52.164321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86kp\" (UniqueName: \"kubernetes.io/projected/a610e725-a70a-4795-984b-c9576b96ad8a-kube-api-access-c86kp\") pod \"kuadrant-operator-catalog-k8sld\" (UID: \"a610e725-a70a-4795-984b-c9576b96ad8a\") " pod="kuadrant-system/kuadrant-operator-catalog-k8sld" Jul 07 18:55:52.173244 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:52.173225 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86kp\" (UniqueName: \"kubernetes.io/projected/a610e725-a70a-4795-984b-c9576b96ad8a-kube-api-access-c86kp\") pod \"kuadrant-operator-catalog-k8sld\" (UID: \"a610e725-a70a-4795-984b-c9576b96ad8a\") " pod="kuadrant-system/kuadrant-operator-catalog-k8sld" Jul 07 18:55:52.221820 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:52.221801 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k8sld" Jul 07 18:55:52.352335 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:52.352241 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:55:52.364983 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:52.364963 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k8sld"] Jul 07 18:55:52.366474 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:55:52.366445 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda610e725_a70a_4795_984b_c9576b96ad8a.slice/crio-286d7e165410f4acdbe89e33d87dd76fbbb0eaeef2f68d5582fba1f32a48a14e WatchSource:0}: Error finding container 286d7e165410f4acdbe89e33d87dd76fbbb0eaeef2f68d5582fba1f32a48a14e: Status 404 returned error can't find the container with id 286d7e165410f4acdbe89e33d87dd76fbbb0eaeef2f68d5582fba1f32a48a14e Jul 07 18:55:53.117420 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:53.117385 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k8sld" event={"ID":"a610e725-a70a-4795-984b-c9576b96ad8a","Type":"ContainerStarted","Data":"286d7e165410f4acdbe89e33d87dd76fbbb0eaeef2f68d5582fba1f32a48a14e"} Jul 07 18:55:54.123934 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:54.123900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k8sld" event={"ID":"a610e725-a70a-4795-984b-c9576b96ad8a","Type":"ContainerStarted","Data":"0e90b3db13432a1fdf81ad7605b6110709601b84379d39634405d7f26bc9f423"} Jul 07 18:55:54.125290 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:54.125267 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" event={"ID":"cb2b84a6-06a3-4a22-9153-31c001d46380","Type":"ContainerStarted","Data":"491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f"} Jul 07 18:55:54.125426 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:54.125319 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" podUID="cb2b84a6-06a3-4a22-9153-31c001d46380" containerName="registry-server" containerID="cri-o://491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f" gracePeriod=2 Jul 07 18:55:54.148300 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:54.148249 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-k8sld" podStartSLOduration=1.8585693989999998 podStartE2EDuration="3.148230303s" totalImagesPullingTime="1.289660904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:54.147477558 +0000 UTC m=+362.206925311" watchObservedRunningTime="2026-07-07 18:55:54.148230303 +0000 UTC m=+362.207678056" Jul 07 18:55:54.172368 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:54.172305 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" podStartSLOduration=1.32302361 podStartE2EDuration="3.172291414s" totalImagesPullingTime="1.849267804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:54.171990482 +0000 UTC m=+362.231438236" watchObservedRunningTime="2026-07-07 18:55:54.172291414 +0000 UTC m=+362.231739164" Jul 07 18:55:54.358558 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:54.358533 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" Jul 07 18:55:54.484067 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:54.483994 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzj5w\" (UniqueName: \"kubernetes.io/projected/cb2b84a6-06a3-4a22-9153-31c001d46380-kube-api-access-lzj5w\") pod \"cb2b84a6-06a3-4a22-9153-31c001d46380\" (UID: \"cb2b84a6-06a3-4a22-9153-31c001d46380\") " Jul 07 18:55:54.486051 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:54.486028 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2b84a6-06a3-4a22-9153-31c001d46380-kube-api-access-lzj5w" (OuterVolumeSpecName: "kube-api-access-lzj5w") pod "cb2b84a6-06a3-4a22-9153-31c001d46380" (UID: "cb2b84a6-06a3-4a22-9153-31c001d46380"). InnerVolumeSpecName "kube-api-access-lzj5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:55:54.585134 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:54.585114 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzj5w\" (UniqueName: \"kubernetes.io/projected/cb2b84a6-06a3-4a22-9153-31c001d46380-kube-api-access-lzj5w\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:55:55.131796 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:55.131755 2582 generic.go:356] "Generic (PLEG): container finished" podID="cb2b84a6-06a3-4a22-9153-31c001d46380" containerID="491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f" exitCode=0 Jul 07 18:55:55.131796 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:55.131797 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" Jul 07 18:55:55.132249 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:55.131835 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" event={"ID":"cb2b84a6-06a3-4a22-9153-31c001d46380","Type":"ContainerDied","Data":"491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f"} Jul 07 18:55:55.132249 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:55.131893 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nd4j4" event={"ID":"cb2b84a6-06a3-4a22-9153-31c001d46380","Type":"ContainerDied","Data":"964322f86e9b0c6909997e52f1b25dfa7402ed960403a65de9d9640210b71f98"} Jul 07 18:55:55.132249 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:55.131919 2582 scope.go:117] "RemoveContainer" containerID="491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f" Jul 07 18:55:55.140826 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:55.140806 2582 scope.go:117] "RemoveContainer" containerID="491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f" Jul 07 18:55:55.141103 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:55:55.141085 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f\": container with ID starting with 491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f not found: ID does not exist" containerID="491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f" Jul 07 18:55:55.141146 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:55.141113 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f"} err="failed to get container status \"491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f\": rpc error: code = NotFound desc = could not find container \"491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f\": container with ID starting with 491fba07e374a9c9133e0708d28265213624fa66794683422b2415550e6ee42f not found: ID does not exist" Jul 07 18:55:55.159710 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:55.159687 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nd4j4"] Jul 07 18:55:55.168107 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:55.168087 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nd4j4"] Jul 07 18:55:56.532810 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:55:56.532778 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb2b84a6-06a3-4a22-9153-31c001d46380" path="/var/lib/kubelet/pods/cb2b84a6-06a3-4a22-9153-31c001d46380/volumes" Jul 07 18:56:02.222718 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:02.222687 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-k8sld" Jul 07 18:56:02.223138 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:02.222768 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-k8sld" Jul 07 18:56:02.244958 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:02.244932 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-k8sld" Jul 07 18:56:03.190869 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:03.190840 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-k8sld" Jul 07 18:56:21.480755 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:21.480716 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:23.895733 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:23.895699 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb"] Jul 07 18:56:23.896168 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:23.896030 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2b84a6-06a3-4a22-9153-31c001d46380" containerName="registry-server" Jul 07 18:56:23.896168 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:23.896041 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2b84a6-06a3-4a22-9153-31c001d46380" containerName="registry-server" Jul 07 18:56:23.896168 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:23.896108 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2b84a6-06a3-4a22-9153-31c001d46380" containerName="registry-server" Jul 07 18:56:23.899241 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:23.899223 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" Jul 07 18:56:23.901773 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:23.901750 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 18:56:23.901873 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:23.901750 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vb7wn\"" Jul 07 18:56:23.916611 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:23.916585 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb"] Jul 07 18:56:23.929868 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:23.929842 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trhnb\" (UniqueName: \"kubernetes.io/projected/8ba9d8c9-58bf-4bff-83c1-db49f8d46300-kube-api-access-trhnb\") pod \"dns-operator-controller-manager-864dd78c4c-t6hpb\" (UID: \"8ba9d8c9-58bf-4bff-83c1-db49f8d46300\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" Jul 07 18:56:24.030433 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:24.030403 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trhnb\" (UniqueName: \"kubernetes.io/projected/8ba9d8c9-58bf-4bff-83c1-db49f8d46300-kube-api-access-trhnb\") pod \"dns-operator-controller-manager-864dd78c4c-t6hpb\" (UID: \"8ba9d8c9-58bf-4bff-83c1-db49f8d46300\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" Jul 07 18:56:24.040862 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:24.040836 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trhnb\" (UniqueName: \"kubernetes.io/projected/8ba9d8c9-58bf-4bff-83c1-db49f8d46300-kube-api-access-trhnb\") pod \"dns-operator-controller-manager-864dd78c4c-t6hpb\" (UID: \"8ba9d8c9-58bf-4bff-83c1-db49f8d46300\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" Jul 07 18:56:24.209235 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:24.209173 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" Jul 07 18:56:24.347867 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:24.347842 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb"] Jul 07 18:56:24.350331 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:56:24.350304 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba9d8c9_58bf_4bff_83c1_db49f8d46300.slice/crio-1fac476fb1b2c60f9792b1a27c124ee0744843a9112560ac0b4b0ccfce3eef8d WatchSource:0}: Error finding container 1fac476fb1b2c60f9792b1a27c124ee0744843a9112560ac0b4b0ccfce3eef8d: Status 404 returned error can't find the container with id 1fac476fb1b2c60f9792b1a27c124ee0744843a9112560ac0b4b0ccfce3eef8d Jul 07 18:56:24.662409 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:24.662380 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:25.274064 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:25.274022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" event={"ID":"8ba9d8c9-58bf-4bff-83c1-db49f8d46300","Type":"ContainerStarted","Data":"1fac476fb1b2c60f9792b1a27c124ee0744843a9112560ac0b4b0ccfce3eef8d"} Jul 07 18:56:25.445571 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:25.445535 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:26.349092 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:26.349064 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:26.453823 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:26.453795 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:27.284447 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:27.284413 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" event={"ID":"8ba9d8c9-58bf-4bff-83c1-db49f8d46300","Type":"ContainerStarted","Data":"f6552ba9a72a6eabdc442da397c1622aa146fbf2b79897cf9dc475fa439ab7d4"} Jul 07 18:56:27.284628 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:27.284558 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" Jul 07 18:56:27.306905 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:27.306854 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" podStartSLOduration=2.346519243 podStartE2EDuration="4.30684078s" totalImagesPullingTime="1.960321537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:27.304001057 +0000 UTC m=+395.363448807" watchObservedRunningTime="2026-07-07 18:56:27.30684078 +0000 UTC m=+395.366288530" Jul 07 18:56:28.001225 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.001189 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q"] Jul 07 18:56:28.005730 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.005708 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" Jul 07 18:56:28.008077 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.008051 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-w77g7\"" Jul 07 18:56:28.020558 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.020537 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q"] Jul 07 18:56:28.065124 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.065095 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r97xv\" (UniqueName: \"kubernetes.io/projected/bc5d96b2-4ac1-4c77-87a2-998ccb985828-kube-api-access-r97xv\") pod \"authorino-operator-75cc8d5cb7-vhp6q\" (UID: \"bc5d96b2-4ac1-4c77-87a2-998ccb985828\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" Jul 07 18:56:28.166573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.166536 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r97xv\" (UniqueName: \"kubernetes.io/projected/bc5d96b2-4ac1-4c77-87a2-998ccb985828-kube-api-access-r97xv\") pod \"authorino-operator-75cc8d5cb7-vhp6q\" (UID: \"bc5d96b2-4ac1-4c77-87a2-998ccb985828\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" Jul 07 18:56:28.175838 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.175812 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r97xv\" (UniqueName: \"kubernetes.io/projected/bc5d96b2-4ac1-4c77-87a2-998ccb985828-kube-api-access-r97xv\") pod \"authorino-operator-75cc8d5cb7-vhp6q\" (UID: \"bc5d96b2-4ac1-4c77-87a2-998ccb985828\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" Jul 07 18:56:28.203024 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.203001 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:28.300647 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.300584 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:28.315454 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.315430 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" Jul 07 18:56:28.448713 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:28.448691 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q"] Jul 07 18:56:28.451164 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:56:28.451131 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5d96b2_4ac1_4c77_87a2_998ccb985828.slice/crio-325a4e8e5b07e2afa3939b585843ed01f7b8c5deec71246ae344951b98963ffb WatchSource:0}: Error finding container 325a4e8e5b07e2afa3939b585843ed01f7b8c5deec71246ae344951b98963ffb: Status 404 returned error can't find the container with id 325a4e8e5b07e2afa3939b585843ed01f7b8c5deec71246ae344951b98963ffb Jul 07 18:56:29.095491 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:29.095461 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:29.297569 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:29.297532 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" event={"ID":"bc5d96b2-4ac1-4c77-87a2-998ccb985828","Type":"ContainerStarted","Data":"325a4e8e5b07e2afa3939b585843ed01f7b8c5deec71246ae344951b98963ffb"} Jul 07 18:56:29.301823 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:29.301728 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:29.410886 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:29.410845 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:31.237004 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.236967 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l"] Jul 07 18:56:31.239305 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.239290 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:56:31.241722 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.241699 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zfhv7\"" Jul 07 18:56:31.254710 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.254688 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l"] Jul 07 18:56:31.293642 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.293615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf7tf\" (UniqueName: \"kubernetes.io/projected/7b452083-bb5a-4ea5-b2bb-cae23b15e9b7-kube-api-access-cf7tf\") pod \"limitador-operator-controller-manager-859d7b78bd-tsp9l\" (UID: \"7b452083-bb5a-4ea5-b2bb-cae23b15e9b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:56:31.309215 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.309178 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" event={"ID":"bc5d96b2-4ac1-4c77-87a2-998ccb985828","Type":"ContainerStarted","Data":"4eac7a8aff2e8eec86bf7e101f7909a294ab176323b62aad3cff5b3a83779a20"} Jul 07 18:56:31.309328 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.309302 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" Jul 07 18:56:31.331032 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.331010 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:31.337344 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.337303 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" podStartSLOduration=2.133819127 podStartE2EDuration="4.337292013s" totalImagesPullingTime="2.203472886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:31.336246422 +0000 UTC m=+399.395694173" watchObservedRunningTime="2026-07-07 18:56:31.337292013 +0000 UTC m=+399.396739764" Jul 07 18:56:31.394079 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.394053 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf7tf\" (UniqueName: \"kubernetes.io/projected/7b452083-bb5a-4ea5-b2bb-cae23b15e9b7-kube-api-access-cf7tf\") pod \"limitador-operator-controller-manager-859d7b78bd-tsp9l\" (UID: \"7b452083-bb5a-4ea5-b2bb-cae23b15e9b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:56:31.404083 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.404062 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf7tf\" (UniqueName: \"kubernetes.io/projected/7b452083-bb5a-4ea5-b2bb-cae23b15e9b7-kube-api-access-cf7tf\") pod \"limitador-operator-controller-manager-859d7b78bd-tsp9l\" (UID: \"7b452083-bb5a-4ea5-b2bb-cae23b15e9b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:56:31.549459 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.549384 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:56:31.692682 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.692634 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l"] Jul 07 18:56:31.695115 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:56:31.695088 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b452083_bb5a_4ea5_b2bb_cae23b15e9b7.slice/crio-337e18d8edabbcfb3e7c9f3167f7ead294981095db22f2348837214cd75cde0d WatchSource:0}: Error finding container 337e18d8edabbcfb3e7c9f3167f7ead294981095db22f2348837214cd75cde0d: Status 404 returned error can't find the container with id 337e18d8edabbcfb3e7c9f3167f7ead294981095db22f2348837214cd75cde0d Jul 07 18:56:31.854803 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:31.854775 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:32.317427 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:32.317299 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" event={"ID":"7b452083-bb5a-4ea5-b2bb-cae23b15e9b7","Type":"ContainerStarted","Data":"337e18d8edabbcfb3e7c9f3167f7ead294981095db22f2348837214cd75cde0d"} Jul 07 18:56:32.544882 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:32.544824 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:33.323306 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:33.323272 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" event={"ID":"7b452083-bb5a-4ea5-b2bb-cae23b15e9b7","Type":"ContainerStarted","Data":"2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d"} Jul 07 18:56:33.323733 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:33.323336 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:56:34.410295 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:34.410263 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:36.029097 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.029042 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" podStartSLOduration=3.917573061 podStartE2EDuration="5.029025184s" totalImagesPullingTime="1.111452123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:33.348557493 +0000 UTC m=+401.408005246" watchObservedRunningTime="2026-07-07 18:56:36.029025184 +0000 UTC m=+404.088472943" Jul 07 18:56:36.029578 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.029241 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf"] Jul 07 18:56:36.031819 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.031802 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:36.034993 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.034971 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hpcqw\"" Jul 07 18:56:36.052580 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.052558 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf"] Jul 07 18:56:36.130064 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.130024 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbndv\" (UniqueName: \"kubernetes.io/projected/23f43785-f43e-4ad7-87b8-673baf3f2102-kube-api-access-nbndv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" (UID: \"23f43785-f43e-4ad7-87b8-673baf3f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:36.130219 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.130111 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f43785-f43e-4ad7-87b8-673baf3f2102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" (UID: \"23f43785-f43e-4ad7-87b8-673baf3f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:36.230659 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.230630 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f43785-f43e-4ad7-87b8-673baf3f2102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" (UID: \"23f43785-f43e-4ad7-87b8-673baf3f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:36.230828 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.230675 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbndv\" (UniqueName: \"kubernetes.io/projected/23f43785-f43e-4ad7-87b8-673baf3f2102-kube-api-access-nbndv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" (UID: \"23f43785-f43e-4ad7-87b8-673baf3f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:36.230990 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.230972 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f43785-f43e-4ad7-87b8-673baf3f2102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" (UID: \"23f43785-f43e-4ad7-87b8-673baf3f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:36.240475 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.240454 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbndv\" (UniqueName: \"kubernetes.io/projected/23f43785-f43e-4ad7-87b8-673baf3f2102-kube-api-access-nbndv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" (UID: \"23f43785-f43e-4ad7-87b8-673baf3f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:36.341483 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.341427 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:36.479063 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.479041 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf"] Jul 07 18:56:36.481697 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:56:36.481669 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f43785_f43e_4ad7_87b8_673baf3f2102.slice/crio-dc7dc548c26840bf7c591fd11d1a46cd1a3329c5555659f518fbf22b4a0289e2 WatchSource:0}: Error finding container dc7dc548c26840bf7c591fd11d1a46cd1a3329c5555659f518fbf22b4a0289e2: Status 404 returned error can't find the container with id dc7dc548c26840bf7c591fd11d1a46cd1a3329c5555659f518fbf22b4a0289e2 Jul 07 18:56:36.979659 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:36.979625 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:37.129837 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:37.129745 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:37.345136 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:37.345050 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" event={"ID":"23f43785-f43e-4ad7-87b8-673baf3f2102","Type":"ContainerStarted","Data":"dc7dc548c26840bf7c591fd11d1a46cd1a3329c5555659f518fbf22b4a0289e2"} Jul 07 18:56:37.368925 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:37.368892 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:37.467046 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:37.466993 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:38.291938 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:38.291900 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6hpb" Jul 07 18:56:41.366851 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:41.366816 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" event={"ID":"23f43785-f43e-4ad7-87b8-673baf3f2102","Type":"ContainerStarted","Data":"093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe"} Jul 07 18:56:41.367300 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:41.366900 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:41.391085 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:41.391040 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" podStartSLOduration=2.182257786 podStartE2EDuration="6.39102713s" totalImagesPullingTime="4.208769344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:41.388782772 +0000 UTC m=+409.448230524" watchObservedRunningTime="2026-07-07 18:56:41.39102713 +0000 UTC m=+409.450474881" Jul 07 18:56:42.320293 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:42.320262 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vhp6q" Jul 07 18:56:42.674242 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:42.674214 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:42.773225 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:42.773185 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:43.109919 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.109888 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:43.213310 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.213272 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:43.750088 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.750055 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v"] Jul 07 18:56:43.751335 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.751305 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:43.753085 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.753068 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:43.755779 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.755640 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gpj4b\"" Jul 07 18:56:43.756180 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.756159 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 18:56:43.756283 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.756170 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 18:56:43.764314 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.764293 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v"] Jul 07 18:56:43.896534 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.896505 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/20853fb6-7134-40fa-a33b-120888746590-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:43.896534 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.896535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/20853fb6-7134-40fa-a33b-120888746590-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:43.896690 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.896557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dq22\" (UniqueName: \"kubernetes.io/projected/20853fb6-7134-40fa-a33b-120888746590-kube-api-access-4dq22\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:43.997340 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.997313 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/20853fb6-7134-40fa-a33b-120888746590-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:43.997473 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.997350 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/20853fb6-7134-40fa-a33b-120888746590-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:43.997473 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.997397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dq22\" (UniqueName: \"kubernetes.io/projected/20853fb6-7134-40fa-a33b-120888746590-kube-api-access-4dq22\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:43.997473 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:56:43.997452 2582 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 07 18:56:43.997689 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:56:43.997513 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20853fb6-7134-40fa-a33b-120888746590-plugin-serving-cert podName:20853fb6-7134-40fa-a33b-120888746590 nodeName:}" failed. No retries permitted until 2026-07-07 18:56:44.497496923 +0000 UTC m=+412.556944652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/20853fb6-7134-40fa-a33b-120888746590-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-nb52v" (UID: "20853fb6-7134-40fa-a33b-120888746590") : secret "plugin-serving-cert" not found Jul 07 18:56:43.998091 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:43.998069 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/20853fb6-7134-40fa-a33b-120888746590-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:44.015213 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:44.015154 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dq22\" (UniqueName: \"kubernetes.io/projected/20853fb6-7134-40fa-a33b-120888746590-kube-api-access-4dq22\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:44.117869 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:44.117841 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:44.331160 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:44.331092 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:56:44.501041 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:44.501007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/20853fb6-7134-40fa-a33b-120888746590-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:44.503257 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:44.503228 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/20853fb6-7134-40fa-a33b-120888746590-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nb52v\" (UID: \"20853fb6-7134-40fa-a33b-120888746590\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:44.662554 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:44.662524 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" Jul 07 18:56:44.807142 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:44.807120 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v"] Jul 07 18:56:44.809030 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:56:44.809006 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20853fb6_7134_40fa_a33b_120888746590.slice/crio-086770a21424ac12877981bf97ebafcc1abc15740108e4b93ef0723b4b956f69 WatchSource:0}: Error finding container 086770a21424ac12877981bf97ebafcc1abc15740108e4b93ef0723b4b956f69: Status 404 returned error can't find the container with id 086770a21424ac12877981bf97ebafcc1abc15740108e4b93ef0723b4b956f69 Jul 07 18:56:45.390366 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:45.390316 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" event={"ID":"20853fb6-7134-40fa-a33b-120888746590","Type":"ContainerStarted","Data":"086770a21424ac12877981bf97ebafcc1abc15740108e4b93ef0723b4b956f69"} Jul 07 18:56:46.460075 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:46.460039 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:46.560306 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:46.560271 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:47.587212 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:47.586974 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74868f4888-hshmt"] Jul 07 18:56:47.718147 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:47.718063 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:49.061676 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:49.061633 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:49.160553 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:49.160515 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:56:52.375138 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:52.375073 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:54.232947 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.232915 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf"] Jul 07 18:56:54.233446 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.233096 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" containerName="manager" containerID="cri-o://093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe" gracePeriod=2 Jul 07 18:56:54.246556 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.246529 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf"] Jul 07 18:56:54.256240 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:56:54.256193 2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"23f43785-f43e-4ad7-87b8-673baf3f2102\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-lppqf\": pods \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:54.266042 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.265655 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l"] Jul 07 18:56:54.266042 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.265875 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" containerName="manager" containerID="cri-o://2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d" gracePeriod=2 Jul 07 18:56:54.267955 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:56:54.267916 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:54.268115 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.268096 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl"] Jul 07 18:56:54.268562 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.268545 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" containerName="manager" Jul 07 18:56:54.268562 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.268562 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" containerName="manager" Jul 07 18:56:54.268710 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.268636 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" containerName="manager" Jul 07 18:56:54.275438 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.274528 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:56:54.282021 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.281997 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l"] Jul 07 18:56:54.292566 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.292539 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl"] Jul 07 18:56:54.301523 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.301502 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv"] Jul 07 18:56:54.302016 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.301998 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" containerName="manager" Jul 07 18:56:54.302100 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.302019 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" containerName="manager" Jul 07 18:56:54.302158 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.302135 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" containerName="manager" Jul 07 18:56:54.305216 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.305195 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" Jul 07 18:56:54.307585 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:56:54.307545 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:54.310378 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:56:54.310267 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsp9l\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:56:54.312547 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:56:54.312516 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsp9l\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:56:54.315059 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:56:54.315033 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:56:54.320999 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.320969 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv"] Jul 07 18:56:54.393700 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.393668 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b97j\" (UniqueName: \"kubernetes.io/projected/dc43ad1a-f776-4956-acd8-980c948ff111-kube-api-access-2b97j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d78zl\" (UID: \"dc43ad1a-f776-4956-acd8-980c948ff111\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:56:54.393810 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.393783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc43ad1a-f776-4956-acd8-980c948ff111-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d78zl\" (UID: \"dc43ad1a-f776-4956-acd8-980c948ff111\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:56:54.393862 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.393823 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r5kh\" (UniqueName: \"kubernetes.io/projected/d71587ac-60cb-4e12-bb84-2890f2fac62c-kube-api-access-6r5kh\") pod \"limitador-operator-controller-manager-859d7b78bd-qw7fv\" (UID: \"d71587ac-60cb-4e12-bb84-2890f2fac62c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" Jul 07 18:56:54.495471 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.495381 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b97j\" (UniqueName: \"kubernetes.io/projected/dc43ad1a-f776-4956-acd8-980c948ff111-kube-api-access-2b97j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d78zl\" (UID: \"dc43ad1a-f776-4956-acd8-980c948ff111\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:56:54.495632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.495492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc43ad1a-f776-4956-acd8-980c948ff111-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d78zl\" (UID: \"dc43ad1a-f776-4956-acd8-980c948ff111\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:56:54.495632 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.495526 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r5kh\" (UniqueName: \"kubernetes.io/projected/d71587ac-60cb-4e12-bb84-2890f2fac62c-kube-api-access-6r5kh\") pod \"limitador-operator-controller-manager-859d7b78bd-qw7fv\" (UID: \"d71587ac-60cb-4e12-bb84-2890f2fac62c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" Jul 07 18:56:54.495889 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.495861 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc43ad1a-f776-4956-acd8-980c948ff111-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d78zl\" (UID: \"dc43ad1a-f776-4956-acd8-980c948ff111\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:56:54.507650 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.507630 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r5kh\" (UniqueName: \"kubernetes.io/projected/d71587ac-60cb-4e12-bb84-2890f2fac62c-kube-api-access-6r5kh\") pod \"limitador-operator-controller-manager-859d7b78bd-qw7fv\" (UID: \"d71587ac-60cb-4e12-bb84-2890f2fac62c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" Jul 07 18:56:54.507776 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.507741 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b97j\" (UniqueName: \"kubernetes.io/projected/dc43ad1a-f776-4956-acd8-980c948ff111-kube-api-access-2b97j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d78zl\" (UID: \"dc43ad1a-f776-4956-acd8-980c948ff111\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:56:54.670879 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.670841 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:56:54.679379 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:54.679307 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" Jul 07 18:56:55.330072 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:56:55.330020 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.36:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 18:57:00.548757 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:00.548714 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:00.650029 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:00.649981 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:05.525704 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:05.525667 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:05.625817 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:05.625780 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:05.726564 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:05.726528 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:05.787628 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:05.787535 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:06.286905 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.286818 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:57:06.289974 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:57:06.289940 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:57:06.305227 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.305204 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbndv\" (UniqueName: \"kubernetes.io/projected/23f43785-f43e-4ad7-87b8-673baf3f2102-kube-api-access-nbndv\") pod \"23f43785-f43e-4ad7-87b8-673baf3f2102\" (UID: \"23f43785-f43e-4ad7-87b8-673baf3f2102\") " Jul 07 18:57:06.305428 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.305408 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f43785-f43e-4ad7-87b8-673baf3f2102-extensions-socket-volume\") pod \"23f43785-f43e-4ad7-87b8-673baf3f2102\" (UID: \"23f43785-f43e-4ad7-87b8-673baf3f2102\") " Jul 07 18:57:06.305875 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.305849 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23f43785-f43e-4ad7-87b8-673baf3f2102-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "23f43785-f43e-4ad7-87b8-673baf3f2102" (UID: "23f43785-f43e-4ad7-87b8-673baf3f2102"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:57:06.309099 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.309071 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23f43785-f43e-4ad7-87b8-673baf3f2102-kube-api-access-nbndv" (OuterVolumeSpecName: "kube-api-access-nbndv") pod "23f43785-f43e-4ad7-87b8-673baf3f2102" (UID: "23f43785-f43e-4ad7-87b8-673baf3f2102"). InnerVolumeSpecName "kube-api-access-nbndv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:57:06.318038 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.318014 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:57:06.320256 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:57:06.320224 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:57:06.322071 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:57:06.322047 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsp9l\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:57:06.326922 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.326903 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl"] Jul 07 18:57:06.329197 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:57:06.329174 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc43ad1a_f776_4956_acd8_980c948ff111.slice/crio-aa9152bd63a7c3c715433fd42aebdecfab151a6beb2dd36d6539c459746b7773 WatchSource:0}: Error finding container aa9152bd63a7c3c715433fd42aebdecfab151a6beb2dd36d6539c459746b7773: Status 404 returned error can't find the container with id aa9152bd63a7c3c715433fd42aebdecfab151a6beb2dd36d6539c459746b7773 Jul 07 18:57:06.350309 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.350287 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv"] Jul 07 18:57:06.368390 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:57:06.368345 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71587ac_60cb_4e12_bb84_2890f2fac62c.slice/crio-1f7eaa2c4624f3eecd7284f20079775fab79b0867ed49890157739a7b7122d21 WatchSource:0}: Error finding container 1f7eaa2c4624f3eecd7284f20079775fab79b0867ed49890157739a7b7122d21: Status 404 returned error can't find the container with id 1f7eaa2c4624f3eecd7284f20079775fab79b0867ed49890157739a7b7122d21 Jul 07 18:57:06.406205 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.406184 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf7tf\" (UniqueName: \"kubernetes.io/projected/7b452083-bb5a-4ea5-b2bb-cae23b15e9b7-kube-api-access-cf7tf\") pod \"7b452083-bb5a-4ea5-b2bb-cae23b15e9b7\" (UID: \"7b452083-bb5a-4ea5-b2bb-cae23b15e9b7\") " Jul 07 18:57:06.406474 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.406441 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23f43785-f43e-4ad7-87b8-673baf3f2102-extensions-socket-volume\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:06.406474 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.406466 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbndv\" (UniqueName: \"kubernetes.io/projected/23f43785-f43e-4ad7-87b8-673baf3f2102-kube-api-access-nbndv\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:06.408274 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.408248 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b452083-bb5a-4ea5-b2bb-cae23b15e9b7-kube-api-access-cf7tf" (OuterVolumeSpecName: "kube-api-access-cf7tf") pod "7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" (UID: "7b452083-bb5a-4ea5-b2bb-cae23b15e9b7"). InnerVolumeSpecName "kube-api-access-cf7tf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:57:06.507267 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.507236 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf7tf\" (UniqueName: \"kubernetes.io/projected/7b452083-bb5a-4ea5-b2bb-cae23b15e9b7-kube-api-access-cf7tf\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:06.513041 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.513011 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" event={"ID":"20853fb6-7134-40fa-a33b-120888746590","Type":"ContainerStarted","Data":"f36df06158838d04fafb68c7b2503fe2b59b4fde5e5b9ba2073b3d17c492f096"} Jul 07 18:57:06.514239 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.514212 2582 generic.go:356] "Generic (PLEG): container finished" podID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" containerID="2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d" exitCode=0 Jul 07 18:57:06.514350 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.514251 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:57:06.514350 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.514299 2582 scope.go:117] "RemoveContainer" containerID="2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d" Jul 07 18:57:06.515245 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:57:06.515215 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsp9l\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsp9l" Jul 07 18:57:06.515831 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.515809 2582 generic.go:356] "Generic (PLEG): container finished" podID="23f43785-f43e-4ad7-87b8-673baf3f2102" containerID="093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe" exitCode=0 Jul 07 18:57:06.515913 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.515849 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:57:06.516959 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:57:06.516936 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lppqf\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lppqf" Jul 07 18:57:06.517719 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.517695 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" event={"ID":"d71587ac-60cb-4e12-bb84-2890f2fac62c","Type":"ContainerStarted","Data":"8b06b87dae01d3ed43bdf6949635310d82362d7ceedbb73acce3b8fbd6ebcf8e"} Jul 07 18:57:06.517834 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.517738 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" event={"ID":"d71587ac-60cb-4e12-bb84-2890f2fac62c","Type":"ContainerStarted","Data":"1f7eaa2c4624f3eecd7284f20079775fab79b0867ed49890157739a7b7122d21"} Jul 07 18:57:06.517834 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.517830 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" Jul 07 18:57:06.519430 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.519400 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" event={"ID":"dc43ad1a-f776-4956-acd8-980c948ff111","Type":"ContainerStarted","Data":"ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560"} Jul 07 18:57:06.519532 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.519444 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" event={"ID":"dc43ad1a-f776-4956-acd8-980c948ff111","Type":"ContainerStarted","Data":"aa9152bd63a7c3c715433fd42aebdecfab151a6beb2dd36d6539c459746b7773"} Jul 07 18:57:06.519532 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.519491 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:57:06.525601 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.525582 2582 scope.go:117] "RemoveContainer" containerID="2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d" Jul 07 18:57:06.525952 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:57:06.525926 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d\": container with ID starting with 2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d not found: ID does not exist" containerID="2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d" Jul 07 18:57:06.526384 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.525960 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d"} err="failed to get container status \"2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d\": rpc error: code = NotFound desc = could not find container \"2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d\": container with ID starting with 2887cc77196c19750225282b11d1e49634b4557eef466fb95069d2645ce73e2d not found: ID does not exist" Jul 07 18:57:06.526384 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.525982 2582 scope.go:117] "RemoveContainer" containerID="093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe" Jul 07 18:57:06.534790 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.534767 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23f43785-f43e-4ad7-87b8-673baf3f2102" path="/var/lib/kubelet/pods/23f43785-f43e-4ad7-87b8-673baf3f2102/volumes" Jul 07 18:57:06.535186 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.535167 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b452083-bb5a-4ea5-b2bb-cae23b15e9b7" path="/var/lib/kubelet/pods/7b452083-bb5a-4ea5-b2bb-cae23b15e9b7/volumes" Jul 07 18:57:06.537128 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.537106 2582 scope.go:117] "RemoveContainer" containerID="093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe" Jul 07 18:57:06.537524 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:57:06.537505 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe\": container with ID starting with 093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe not found: ID does not exist" containerID="093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe" Jul 07 18:57:06.537613 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.537530 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe"} err="failed to get container status \"093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe\": rpc error: code = NotFound desc = could not find container \"093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe\": container with ID starting with 093b2a4882f83bb2aeab9a554cb360fb878ea88b24f9e862b34344fccae972fe not found: ID does not exist" Jul 07 18:57:06.538157 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.538117 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nb52v" podStartSLOduration=2.172934745 podStartE2EDuration="23.53810493s" totalImagesPullingTime="21.365170185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:06.535670904 +0000 UTC m=+434.595118657" watchObservedRunningTime="2026-07-07 18:57:06.53810493 +0000 UTC m=+434.597552717" Jul 07 18:57:06.567628 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.567582 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" podStartSLOduration=12.567571066 podStartE2EDuration="12.567571066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:06.566554599 +0000 UTC m=+434.626002353" watchObservedRunningTime="2026-07-07 18:57:06.567571066 +0000 UTC m=+434.627018832" Jul 07 18:57:06.592104 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:06.592055 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" podStartSLOduration=12.592041138999999 podStartE2EDuration="12.592041139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:06.591210954 +0000 UTC m=+434.650658706" watchObservedRunningTime="2026-07-07 18:57:06.592041139 +0000 UTC m=+434.651488891" Jul 07 18:57:08.173695 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:08.173665 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:08.278212 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:08.278178 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:11.771532 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:11.771498 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:11.869545 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:11.869518 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:12.617770 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.617719 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74868f4888-hshmt" podUID="45510bf1-5dcd-4707-92b0-2337ea078371" containerName="console" containerID="cri-o://747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11" gracePeriod=15 Jul 07 18:57:12.640159 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.640124 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl"] Jul 07 18:57:12.640317 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.640297 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" podUID="dc43ad1a-f776-4956-acd8-980c948ff111" containerName="manager" containerID="cri-o://ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560" gracePeriod=10 Jul 07 18:57:12.641917 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.641893 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:57:12.905864 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.905838 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:57:12.908492 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.908472 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:57:12.960292 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960259 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbsw5\" (UniqueName: \"kubernetes.io/projected/45510bf1-5dcd-4707-92b0-2337ea078371-kube-api-access-bbsw5\") pod \"45510bf1-5dcd-4707-92b0-2337ea078371\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " Jul 07 18:57:12.960459 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960314 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-serving-cert\") pod \"45510bf1-5dcd-4707-92b0-2337ea078371\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " Jul 07 18:57:12.960459 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960340 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-service-ca\") pod \"45510bf1-5dcd-4707-92b0-2337ea078371\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " Jul 07 18:57:12.960459 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960401 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-trusted-ca-bundle\") pod \"45510bf1-5dcd-4707-92b0-2337ea078371\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " Jul 07 18:57:12.960459 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960425 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-console-config\") pod \"45510bf1-5dcd-4707-92b0-2337ea078371\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " Jul 07 18:57:12.960459 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960457 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-oauth-serving-cert\") pod \"45510bf1-5dcd-4707-92b0-2337ea078371\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " Jul 07 18:57:12.960722 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960502 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc43ad1a-f776-4956-acd8-980c948ff111-extensions-socket-volume\") pod \"dc43ad1a-f776-4956-acd8-980c948ff111\" (UID: \"dc43ad1a-f776-4956-acd8-980c948ff111\") " Jul 07 18:57:12.960722 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960533 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-oauth-config\") pod \"45510bf1-5dcd-4707-92b0-2337ea078371\" (UID: \"45510bf1-5dcd-4707-92b0-2337ea078371\") " Jul 07 18:57:12.960722 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960575 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b97j\" (UniqueName: \"kubernetes.io/projected/dc43ad1a-f776-4956-acd8-980c948ff111-kube-api-access-2b97j\") pod \"dc43ad1a-f776-4956-acd8-980c948ff111\" (UID: \"dc43ad1a-f776-4956-acd8-980c948ff111\") " Jul 07 18:57:12.960891 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960864 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "45510bf1-5dcd-4707-92b0-2337ea078371" (UID: "45510bf1-5dcd-4707-92b0-2337ea078371"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:57:12.960965 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.960872 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-console-config" (OuterVolumeSpecName: "console-config") pod "45510bf1-5dcd-4707-92b0-2337ea078371" (UID: "45510bf1-5dcd-4707-92b0-2337ea078371"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:57:12.961242 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.961215 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "45510bf1-5dcd-4707-92b0-2337ea078371" (UID: "45510bf1-5dcd-4707-92b0-2337ea078371"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:57:12.961242 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.961231 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc43ad1a-f776-4956-acd8-980c948ff111-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dc43ad1a-f776-4956-acd8-980c948ff111" (UID: "dc43ad1a-f776-4956-acd8-980c948ff111"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:57:12.961421 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.961399 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-service-ca" (OuterVolumeSpecName: "service-ca") pod "45510bf1-5dcd-4707-92b0-2337ea078371" (UID: "45510bf1-5dcd-4707-92b0-2337ea078371"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:57:12.962881 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.962857 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "45510bf1-5dcd-4707-92b0-2337ea078371" (UID: "45510bf1-5dcd-4707-92b0-2337ea078371"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:57:12.963694 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.963666 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "45510bf1-5dcd-4707-92b0-2337ea078371" (UID: "45510bf1-5dcd-4707-92b0-2337ea078371"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:57:12.964077 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.964058 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45510bf1-5dcd-4707-92b0-2337ea078371-kube-api-access-bbsw5" (OuterVolumeSpecName: "kube-api-access-bbsw5") pod "45510bf1-5dcd-4707-92b0-2337ea078371" (UID: "45510bf1-5dcd-4707-92b0-2337ea078371"). InnerVolumeSpecName "kube-api-access-bbsw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:57:12.964141 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.964097 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc43ad1a-f776-4956-acd8-980c948ff111-kube-api-access-2b97j" (OuterVolumeSpecName: "kube-api-access-2b97j") pod "dc43ad1a-f776-4956-acd8-980c948ff111" (UID: "dc43ad1a-f776-4956-acd8-980c948ff111"). InnerVolumeSpecName "kube-api-access-2b97j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:57:12.964662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.964645 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj"] Jul 07 18:57:12.965072 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.965054 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45510bf1-5dcd-4707-92b0-2337ea078371" containerName="console" Jul 07 18:57:12.965072 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.965073 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="45510bf1-5dcd-4707-92b0-2337ea078371" containerName="console" Jul 07 18:57:12.965236 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.965088 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc43ad1a-f776-4956-acd8-980c948ff111" containerName="manager" Jul 07 18:57:12.965236 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.965096 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc43ad1a-f776-4956-acd8-980c948ff111" containerName="manager" Jul 07 18:57:12.965236 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.965196 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="45510bf1-5dcd-4707-92b0-2337ea078371" containerName="console" Jul 07 18:57:12.965236 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.965208 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc43ad1a-f776-4956-acd8-980c948ff111" containerName="manager" Jul 07 18:57:12.968122 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.968106 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:12.983458 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:12.983414 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj"] Jul 07 18:57:13.061566 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q7mx\" (UniqueName: \"kubernetes.io/projected/f30a7bf0-2588-403d-94ab-d9bf427a48a2-kube-api-access-4q7mx\") pod \"kuadrant-operator-controller-manager-86878c769f-fvqbj\" (UID: \"f30a7bf0-2588-403d-94ab-d9bf427a48a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:13.061708 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061602 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f30a7bf0-2588-403d-94ab-d9bf427a48a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fvqbj\" (UID: \"f30a7bf0-2588-403d-94ab-d9bf427a48a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:13.061708 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061640 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbsw5\" (UniqueName: \"kubernetes.io/projected/45510bf1-5dcd-4707-92b0-2337ea078371-kube-api-access-bbsw5\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:13.061708 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061650 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-serving-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:13.061708 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061659 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-service-ca\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:13.061708 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061672 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-trusted-ca-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:13.061708 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061696 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-console-config\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:13.061708 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061711 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45510bf1-5dcd-4707-92b0-2337ea078371-oauth-serving-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:13.061929 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061720 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc43ad1a-f776-4956-acd8-980c948ff111-extensions-socket-volume\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:13.061929 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061729 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45510bf1-5dcd-4707-92b0-2337ea078371-console-oauth-config\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:13.061929 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.061740 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b97j\" (UniqueName: \"kubernetes.io/projected/dc43ad1a-f776-4956-acd8-980c948ff111-kube-api-access-2b97j\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\"" Jul 07 18:57:13.162662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.162580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f30a7bf0-2588-403d-94ab-d9bf427a48a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fvqbj\" (UID: \"f30a7bf0-2588-403d-94ab-d9bf427a48a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:13.162662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.162644 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q7mx\" (UniqueName: \"kubernetes.io/projected/f30a7bf0-2588-403d-94ab-d9bf427a48a2-kube-api-access-4q7mx\") pod \"kuadrant-operator-controller-manager-86878c769f-fvqbj\" (UID: \"f30a7bf0-2588-403d-94ab-d9bf427a48a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:13.162969 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.162945 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f30a7bf0-2588-403d-94ab-d9bf427a48a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fvqbj\" (UID: \"f30a7bf0-2588-403d-94ab-d9bf427a48a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:13.175591 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.175566 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q7mx\" (UniqueName: \"kubernetes.io/projected/f30a7bf0-2588-403d-94ab-d9bf427a48a2-kube-api-access-4q7mx\") pod \"kuadrant-operator-controller-manager-86878c769f-fvqbj\" (UID: \"f30a7bf0-2588-403d-94ab-d9bf427a48a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:13.287149 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.287119 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:13.420681 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.420625 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj"] Jul 07 18:57:13.423048 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:57:13.423020 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30a7bf0_2588_403d_94ab_d9bf427a48a2.slice/crio-4cbff75984d9ea9a8b370674816788032ff23c509b390b4548840cdcf3a407f7 WatchSource:0}: Error finding container 4cbff75984d9ea9a8b370674816788032ff23c509b390b4548840cdcf3a407f7: Status 404 returned error can't find the container with id 4cbff75984d9ea9a8b370674816788032ff23c509b390b4548840cdcf3a407f7 Jul 07 18:57:13.554547 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.554511 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" event={"ID":"f30a7bf0-2588-403d-94ab-d9bf427a48a2","Type":"ContainerStarted","Data":"97c5e5236062579330c973d7f5e95b53aabb98cfac575426fe0d28109f87d450"} Jul 07 18:57:13.554666 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.554652 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:13.554720 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.554680 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" event={"ID":"f30a7bf0-2588-403d-94ab-d9bf427a48a2","Type":"ContainerStarted","Data":"4cbff75984d9ea9a8b370674816788032ff23c509b390b4548840cdcf3a407f7"} Jul 07 18:57:13.555859 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.555835 2582 generic.go:356] "Generic (PLEG): container finished" podID="45510bf1-5dcd-4707-92b0-2337ea078371" containerID="747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11" exitCode=0 Jul 07 18:57:13.555976 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.555873 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74868f4888-hshmt" Jul 07 18:57:13.555976 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.555907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74868f4888-hshmt" event={"ID":"45510bf1-5dcd-4707-92b0-2337ea078371","Type":"ContainerDied","Data":"747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11"} Jul 07 18:57:13.555976 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.555943 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74868f4888-hshmt" event={"ID":"45510bf1-5dcd-4707-92b0-2337ea078371","Type":"ContainerDied","Data":"fa0abada0da4faa2abf46707fb954348ce2ee316f647d526a15320817aa2f6a6"} Jul 07 18:57:13.555976 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.555962 2582 scope.go:117] "RemoveContainer" containerID="747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11" Jul 07 18:57:13.557451 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.557426 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc43ad1a-f776-4956-acd8-980c948ff111" containerID="ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560" exitCode=0 Jul 07 18:57:13.557542 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.557467 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" Jul 07 18:57:13.557542 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.557478 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" event={"ID":"dc43ad1a-f776-4956-acd8-980c948ff111","Type":"ContainerDied","Data":"ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560"} Jul 07 18:57:13.557542 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.557517 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl" event={"ID":"dc43ad1a-f776-4956-acd8-980c948ff111","Type":"ContainerDied","Data":"aa9152bd63a7c3c715433fd42aebdecfab151a6beb2dd36d6539c459746b7773"} Jul 07 18:57:13.564226 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.564208 2582 scope.go:117] "RemoveContainer" containerID="747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11" Jul 07 18:57:13.564645 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:57:13.564481 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11\": container with ID starting with 747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11 not found: ID does not exist" containerID="747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11" Jul 07 18:57:13.564645 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.564515 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11"} err="failed to get container status \"747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11\": rpc error: code = NotFound desc = could not find container \"747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11\": container with ID starting with 747b6b16a5ec8e5604d06613048931257f0d68e3bcde3296772df9baf6cf3a11 not found: ID does not exist" Jul 07 18:57:13.564645 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.564536 2582 scope.go:117] "RemoveContainer" containerID="ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560" Jul 07 18:57:13.572027 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.572011 2582 scope.go:117] "RemoveContainer" containerID="ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560" Jul 07 18:57:13.572258 ip-10-0-133-11 kubenswrapper[2582]: E0707 18:57:13.572241 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560\": container with ID starting with ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560 not found: ID does not exist" containerID="ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560" Jul 07 18:57:13.572307 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.572264 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560"} err="failed to get container status \"ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560\": rpc error: code = NotFound desc = could not find container \"ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560\": container with ID starting with ec8df93db09335253abaeecb169241148e739c7b5e426fc53cade11f255d5560 not found: ID does not exist" Jul 07 18:57:13.580565 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.580524 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" podStartSLOduration=1.580511505 podStartE2EDuration="1.580511505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:13.578756575 +0000 UTC m=+441.638204328" watchObservedRunningTime="2026-07-07 18:57:13.580511505 +0000 UTC m=+441.639959256" Jul 07 18:57:13.598148 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.598121 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74868f4888-hshmt"] Jul 07 18:57:13.600450 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.600428 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74868f4888-hshmt"] Jul 07 18:57:13.613143 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.613113 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl"] Jul 07 18:57:13.621196 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:13.621173 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d78zl"] Jul 07 18:57:14.538194 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:14.538119 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45510bf1-5dcd-4707-92b0-2337ea078371" path="/var/lib/kubelet/pods/45510bf1-5dcd-4707-92b0-2337ea078371/volumes" Jul 07 18:57:14.538611 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:14.538593 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc43ad1a-f776-4956-acd8-980c948ff111" path="/var/lib/kubelet/pods/dc43ad1a-f776-4956-acd8-980c948ff111/volumes" Jul 07 18:57:17.527538 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:17.527502 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qw7fv" Jul 07 18:57:24.566528 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:24.566500 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fvqbj" Jul 07 18:57:29.048713 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.048678 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2"] Jul 07 18:57:29.079504 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.079474 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:29.181532 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.181503 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2"] Jul 07 18:57:29.181681 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.181598 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.184448 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.184423 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 18:57:29.184573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.184523 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wb59x\"" Jul 07 18:57:29.265718 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.265696 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:29.292435 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.292409 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.292545 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.292449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.292545 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.292473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.292545 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.292516 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.292720 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.292555 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8zrc\" (UniqueName: \"kubernetes.io/projected/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-kube-api-access-v8zrc\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.292720 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.292596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.292720 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.292702 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.292909 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.292743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.292909 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.292767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394011 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.393984 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394121 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394121 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8zrc\" (UniqueName: \"kubernetes.io/projected/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-kube-api-access-v8zrc\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394121 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394068 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394268 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394126 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394268 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394268 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394268 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394257 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394477 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394477 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394416 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394662 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394629 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394793 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394677 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394793 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.394990 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.394968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.396437 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.396412 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.396669 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.396652 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.402880 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.402861 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.403004 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.402985 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8zrc\" (UniqueName: \"kubernetes.io/projected/bc6ca085-cd2d-4644-9866-7ad5b4e15b2e-kube-api-access-v8zrc\") pod \"maas-default-gateway-openshift-default-56654dcf7-gt4g2\" (UID: \"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.493794 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.493760 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:29.654164 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:29.654143 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2"] Jul 07 18:57:29.656853 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:57:29.656823 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6ca085_cd2d_4644_9866_7ad5b4e15b2e.slice/crio-12925c9583390248a74e487ecdc5c04152230958349826a2284179ec014f947c WatchSource:0}: Error finding container 12925c9583390248a74e487ecdc5c04152230958349826a2284179ec014f947c: Status 404 returned error can't find the container with id 12925c9583390248a74e487ecdc5c04152230958349826a2284179ec014f947c Jul 07 18:57:30.644446 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:30.644410 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" event={"ID":"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e","Type":"ContainerStarted","Data":"12925c9583390248a74e487ecdc5c04152230958349826a2284179ec014f947c"} Jul 07 18:57:33.896689 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:33.896644 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:57:33.896974 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:33.896727 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:57:33.896974 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:33.896754 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:57:34.668624 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:34.668585 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" event={"ID":"bc6ca085-cd2d-4644-9866-7ad5b4e15b2e","Type":"ContainerStarted","Data":"ef6bcc91889dfca98e3b5e6e4de713a15a61f8f96fa7277422e595b76d0e7e45"} Jul 07 18:57:34.694964 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:34.694916 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" podStartSLOduration=1.457351524 podStartE2EDuration="5.694900335s" totalImagesPullingTime="4.237548811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:34.692910184 +0000 UTC m=+462.752357948" watchObservedRunningTime="2026-07-07 18:57:34.694900335 +0000 UTC m=+462.754348149" Jul 07 18:57:35.494696 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:35.494663 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:35.499534 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:35.499512 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:35.673836 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:35.673797 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:35.674770 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:35.674751 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gt4g2" Jul 07 18:57:44.714123 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:44.714088 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:44.820924 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:44.820886 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:44.884573 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:44.884536 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:45.175406 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.175371 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bdkcz"] Jul 07 18:57:45.198148 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.198117 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bdkcz"] Jul 07 18:57:45.198330 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.198218 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:57:45.200523 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.200503 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 18:57:45.214513 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.214487 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bdkcz"] Jul 07 18:57:45.339076 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.339045 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7570baf7-6e1d-4d3d-aec1-aa4d355f629e-config-file\") pod \"limitador-limitador-54d6d988d5-bdkcz\" (UID: \"7570baf7-6e1d-4d3d-aec1-aa4d355f629e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:57:45.339076 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.339076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7ptl\" (UniqueName: \"kubernetes.io/projected/7570baf7-6e1d-4d3d-aec1-aa4d355f629e-kube-api-access-p7ptl\") pod \"limitador-limitador-54d6d988d5-bdkcz\" (UID: \"7570baf7-6e1d-4d3d-aec1-aa4d355f629e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:57:45.440536 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.440453 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7570baf7-6e1d-4d3d-aec1-aa4d355f629e-config-file\") pod \"limitador-limitador-54d6d988d5-bdkcz\" (UID: \"7570baf7-6e1d-4d3d-aec1-aa4d355f629e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:57:45.440536 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.440490 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7ptl\" (UniqueName: \"kubernetes.io/projected/7570baf7-6e1d-4d3d-aec1-aa4d355f629e-kube-api-access-p7ptl\") pod \"limitador-limitador-54d6d988d5-bdkcz\" (UID: \"7570baf7-6e1d-4d3d-aec1-aa4d355f629e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:57:45.441095 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.441073 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7570baf7-6e1d-4d3d-aec1-aa4d355f629e-config-file\") pod \"limitador-limitador-54d6d988d5-bdkcz\" (UID: \"7570baf7-6e1d-4d3d-aec1-aa4d355f629e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:57:45.449419 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.449387 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7ptl\" (UniqueName: \"kubernetes.io/projected/7570baf7-6e1d-4d3d-aec1-aa4d355f629e-kube-api-access-p7ptl\") pod \"limitador-limitador-54d6d988d5-bdkcz\" (UID: \"7570baf7-6e1d-4d3d-aec1-aa4d355f629e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:57:45.509120 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.509090 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:57:45.634577 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.634530 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:45.663955 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.663931 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bdkcz"] Jul 07 18:57:45.666907 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:57:45.666880 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7570baf7_6e1d_4d3d_aec1_aa4d355f629e.slice/crio-0077fdde590459010867590baf1a9cd846cca84765d4db38827a534469c6a504 WatchSource:0}: Error finding container 0077fdde590459010867590baf1a9cd846cca84765d4db38827a534469c6a504: Status 404 returned error can't find the container with id 0077fdde590459010867590baf1a9cd846cca84765d4db38827a534469c6a504 Jul 07 18:57:45.722676 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.722602 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" event={"ID":"7570baf7-6e1d-4d3d-aec1-aa4d355f629e","Type":"ContainerStarted","Data":"0077fdde590459010867590baf1a9cd846cca84765d4db38827a534469c6a504"} Jul 07 18:57:45.733970 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:45.733945 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:48.739203 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:48.739171 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" event={"ID":"7570baf7-6e1d-4d3d-aec1-aa4d355f629e","Type":"ContainerStarted","Data":"ea6ddee7895b95d1c0f28263fd883688d6cbc24612e6732819af73d69852f8c2"} Jul 07 18:57:48.739638 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:48.739295 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:57:48.763334 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:48.763288 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" podStartSLOduration=1.234520704 podStartE2EDuration="3.763274517s" totalImagesPullingTime="2.528753813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:48.762020567 +0000 UTC m=+476.821468320" watchObservedRunningTime="2026-07-07 18:57:48.763274517 +0000 UTC m=+476.822722268" Jul 07 18:57:57.283325 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:57.283285 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:57:59.745515 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:57:59.745487 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bdkcz" Jul 07 18:58:02.468320 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:02.468286 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:05.341467 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:05.341379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:05.443401 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:05.443372 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:14.256706 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:14.256666 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:14.429768 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:14.429733 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:15.083448 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.083405 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b5df69bb8-qgcvw"] Jul 07 18:58:15.089379 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.089335 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" Jul 07 18:58:15.092764 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.092743 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9spzj\"" Jul 07 18:58:15.093022 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.092855 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 18:58:15.095162 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.095142 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b5df69bb8-qgcvw"] Jul 07 18:58:15.164236 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.164212 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6klhf\" (UniqueName: \"kubernetes.io/projected/9c4652e3-de81-42a6-be91-091f1aa18805-kube-api-access-6klhf\") pod \"authorino-7b5df69bb8-qgcvw\" (UID: \"9c4652e3-de81-42a6-be91-091f1aa18805\") " pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" Jul 07 18:58:15.164385 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.164254 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c4652e3-de81-42a6-be91-091f1aa18805-tls-cert\") pod \"authorino-7b5df69bb8-qgcvw\" (UID: \"9c4652e3-de81-42a6-be91-091f1aa18805\") " pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" Jul 07 18:58:15.264990 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.264960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6klhf\" (UniqueName: \"kubernetes.io/projected/9c4652e3-de81-42a6-be91-091f1aa18805-kube-api-access-6klhf\") pod \"authorino-7b5df69bb8-qgcvw\" (UID: \"9c4652e3-de81-42a6-be91-091f1aa18805\") " pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" Jul 07 18:58:15.265393 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.265002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c4652e3-de81-42a6-be91-091f1aa18805-tls-cert\") pod \"authorino-7b5df69bb8-qgcvw\" (UID: \"9c4652e3-de81-42a6-be91-091f1aa18805\") " pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" Jul 07 18:58:15.267345 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.267322 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c4652e3-de81-42a6-be91-091f1aa18805-tls-cert\") pod \"authorino-7b5df69bb8-qgcvw\" (UID: \"9c4652e3-de81-42a6-be91-091f1aa18805\") " pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" Jul 07 18:58:15.274112 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.274088 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6klhf\" (UniqueName: \"kubernetes.io/projected/9c4652e3-de81-42a6-be91-091f1aa18805-kube-api-access-6klhf\") pod \"authorino-7b5df69bb8-qgcvw\" (UID: \"9c4652e3-de81-42a6-be91-091f1aa18805\") " pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" Jul 07 18:58:15.399318 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.399287 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" Jul 07 18:58:15.531919 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.531896 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b5df69bb8-qgcvw"] Jul 07 18:58:15.533935 ip-10-0-133-11 kubenswrapper[2582]: W0707 18:58:15.533905 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c4652e3_de81_42a6_be91_091f1aa18805.slice/crio-463bd31eedeaf572aa9a45788e6ab047466b98c3985ceced348849d0ea6b6fc2 WatchSource:0}: Error finding container 463bd31eedeaf572aa9a45788e6ab047466b98c3985ceced348849d0ea6b6fc2: Status 404 returned error can't find the container with id 463bd31eedeaf572aa9a45788e6ab047466b98c3985ceced348849d0ea6b6fc2 Jul 07 18:58:15.872606 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:15.872571 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" event={"ID":"9c4652e3-de81-42a6-be91-091f1aa18805","Type":"ContainerStarted","Data":"463bd31eedeaf572aa9a45788e6ab047466b98c3985ceced348849d0ea6b6fc2"} Jul 07 18:58:18.889783 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:18.889748 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" event={"ID":"9c4652e3-de81-42a6-be91-091f1aa18805","Type":"ContainerStarted","Data":"e6a30e4b0a86ef0b953582704718858a870fe1695d168c0f5e0a339338bd1469"} Jul 07 18:58:18.909226 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:18.909179 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b5df69bb8-qgcvw" podStartSLOduration=0.748925345 podStartE2EDuration="3.909165958s" totalImagesPullingTime="3.160240613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:18.908818742 +0000 UTC m=+506.968266507" watchObservedRunningTime="2026-07-07 18:58:18.909165958 +0000 UTC m=+506.968613709" Jul 07 18:58:23.401778 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:23.401740 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:23.475387 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:23.475314 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:23.540513 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:23.540482 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:23.794467 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:23.794369 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:26.889830 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:26.889798 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:26.974518 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:26.974484 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:50.120538 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:50.120445 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:50.182848 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:50.182811 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:58:54.180558 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:58:54.180523 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:59:17.333913 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:59:17.333875 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:59:20.166557 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:59:20.166518 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:59:20.228567 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:59:20.228539 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 18:59:52.421985 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:59:52.421947 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 18:59:52.422968 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:59:52.422942 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 18:59:58.975486 ip-10-0-133-11 kubenswrapper[2582]: I0707 18:59:58.975439 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 19:01:26.929732 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:01:26.929691 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 19:04:52.452256 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:04:52.452223 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 19:04:52.453483 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:04:52.453465 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 19:04:53.729444 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:04:53.729409 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 19:05:28.209137 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:05:28.209098 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 19:08:46.059317 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:46.059281 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b5df69bb8-qgcvw_9c4652e3-de81-42a6-be91-091f1aa18805/authorino/0.log" Jul 07 19:08:49.357692 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:49.357661 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-m7dnt_83e23d62-c388-4dc1-a1ae-e2e6940b5dbd/manager/0.log" Jul 07 19:08:49.474662 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:49.474628 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ls8tl_006722ab-44d9-4c99-bb99-ee336d4d2932/manager/0.log" Jul 07 19:08:49.716794 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:49.716692 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nlv9v_f7c00999-8a91-49bd-b7f4-3517ab2ac8b5/server/0.log" Jul 07 19:08:49.859011 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:49.858956 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-b6j28_67f592e6-29e6-4cc9-8616-8a29a9fad7e1/manager/0.log" Jul 07 19:08:50.258079 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:50.258052 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf_341f2d94-e418-4e55-acb9-486db24453eb/copy-manifests/0.log" Jul 07 19:08:50.277158 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:50.277127 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf_341f2d94-e418-4e55-acb9-486db24453eb/manager/0.log" Jul 07 19:08:56.697088 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:56.697053 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b5df69bb8-qgcvw_9c4652e3-de81-42a6-be91-091f1aa18805/authorino/0.log" Jul 07 19:08:56.816760 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:56.816726 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vhp6q_bc5d96b2-4ac1-4c77-87a2-998ccb985828/manager/0.log" Jul 07 19:08:56.934728 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:56.934700 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t6hpb_8ba9d8c9-58bf-4bff-83c1-db49f8d46300/manager/0.log" Jul 07 19:08:57.049144 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:57.049079 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nb52v_20853fb6-7134-40fa-a33b-120888746590/kuadrant-console-plugin/0.log" Jul 07 19:08:57.187280 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:57.187249 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k8sld_a610e725-a70a-4795-984b-c9576b96ad8a/registry-server/0.log" Jul 07 19:08:57.315207 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:57.315136 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fvqbj_f30a7bf0-2588-403d-94ab-d9bf427a48a2/manager/0.log" Jul 07 19:08:57.428630 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:57.428609 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bdkcz_7570baf7-6e1d-4d3d-aec1-aa4d355f629e/limitador/0.log" Jul 07 19:08:57.539584 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:57.539562 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qw7fv_d71587ac-60cb-4e12-bb84-2890f2fac62c/manager/0.log" Jul 07 19:08:58.253520 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:58.253486 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85b6b9f996-ktfxb_4215c973-8f45-40dc-9470-dd0e573e956f/kube-auth-proxy/0.log" Jul 07 19:08:58.365685 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:58.365656 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gt4g2_bc6ca085-cd2d-4644-9866-7ad5b4e15b2e/istio-proxy/0.log" Jul 07 19:08:58.481412 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:08:58.481381 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ccb877549-pms8p_b353dd5b-714f-4635-87b1-4577cdac4974/router/0.log" Jul 07 19:09:02.456739 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:02.456708 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:02.551124 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:02.551091 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" limit=1024 Jul 07 19:09:05.685757 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:05.685727 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rxrn4_a6ab5966-dc6c-45e1-8a34-fa10502ebb56/global-pull-secret-syncer/0.log" Jul 07 19:09:05.801708 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:05.801675 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6tspt_96e0f7c3-2129-4fbe-b8b0-f98c40dfdeec/konnectivity-agent/0.log" Jul 07 19:09:05.913842 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:05.913814 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-11.ec2.internal_9534bd1ba9e0a23b627fcaab9f623fa1/haproxy/0.log" Jul 07 19:09:10.725847 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:10.725819 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b5df69bb8-qgcvw_9c4652e3-de81-42a6-be91-091f1aa18805/authorino/0.log" Jul 07 19:09:10.758350 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:10.758327 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vhp6q_bc5d96b2-4ac1-4c77-87a2-998ccb985828/manager/0.log" Jul 07 19:09:10.800497 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:10.800475 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t6hpb_8ba9d8c9-58bf-4bff-83c1-db49f8d46300/manager/0.log" Jul 07 19:09:10.827594 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:10.827570 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nb52v_20853fb6-7134-40fa-a33b-120888746590/kuadrant-console-plugin/0.log" Jul 07 19:09:10.871048 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:10.871028 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k8sld_a610e725-a70a-4795-984b-c9576b96ad8a/registry-server/0.log" Jul 07 19:09:10.900411 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:10.900348 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fvqbj_f30a7bf0-2588-403d-94ab-d9bf427a48a2/manager/0.log" Jul 07 19:09:10.924175 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:10.924153 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bdkcz_7570baf7-6e1d-4d3d-aec1-aa4d355f629e/limitador/0.log" Jul 07 19:09:10.953158 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:10.953141 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qw7fv_d71587ac-60cb-4e12-bb84-2890f2fac62c/manager/0.log" Jul 07 19:09:12.474558 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:12.474522 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e2b89ac-39d2-4c4b-8a6c-34170ca76db5/alertmanager/0.log" Jul 07 19:09:12.504120 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:12.504096 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e2b89ac-39d2-4c4b-8a6c-34170ca76db5/config-reloader/0.log" Jul 07 19:09:12.530147 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:12.530128 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e2b89ac-39d2-4c4b-8a6c-34170ca76db5/kube-rbac-proxy-web/0.log" Jul 07 19:09:12.554189 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:12.554167 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e2b89ac-39d2-4c4b-8a6c-34170ca76db5/kube-rbac-proxy/0.log" Jul 07 19:09:12.576131 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:12.576109 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e2b89ac-39d2-4c4b-8a6c-34170ca76db5/kube-rbac-proxy-metric/0.log" Jul 07 19:09:12.602963 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:12.602941 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e2b89ac-39d2-4c4b-8a6c-34170ca76db5/prom-label-proxy/0.log" Jul 07 19:09:12.626922 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:12.626903 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e2b89ac-39d2-4c4b-8a6c-34170ca76db5/init-config-reloader/0.log" Jul 07 19:09:12.779028 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:12.778942 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8486d8c78c-prjhx_c8de9c9f-12b9-46fa-95b9-724acf14d60a/metrics-server/0.log" Jul 07 19:09:12.806282 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:12.806257 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-b6hqv_be883a99-f776-4f66-9b9b-6e1306c97b04/monitoring-plugin/0.log" Jul 07 19:09:13.061059 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:13.061032 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4pjg_b3d59249-fe5a-4676-a015-34c406eb4544/node-exporter/0.log" Jul 07 19:09:13.087001 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:13.086979 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4pjg_b3d59249-fe5a-4676-a015-34c406eb4544/kube-rbac-proxy/0.log" Jul 07 19:09:13.113672 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:13.113650 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f4pjg_b3d59249-fe5a-4676-a015-34c406eb4544/init-textfile/0.log" Jul 07 19:09:13.552768 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:13.552720 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d968c6994-vfphx_ad4e2c80-d9b8-439b-82fd-18270686a609/telemeter-client/0.log" Jul 07 19:09:13.582212 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:13.582188 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d968c6994-vfphx_ad4e2c80-d9b8-439b-82fd-18270686a609/reload/0.log" Jul 07 19:09:13.606333 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:13.606311 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d968c6994-vfphx_ad4e2c80-d9b8-439b-82fd-18270686a609/kube-rbac-proxy/0.log" Jul 07 19:09:15.660578 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.660546 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4"] Jul 07 19:09:15.663025 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.663009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.665411 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.665388 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zqqk9\"/\"kube-root-ca.crt\"" Jul 07 19:09:15.665544 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.665527 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zqqk9\"/\"openshift-service-ca.crt\"" Jul 07 19:09:15.666403 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.666384 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zqqk9\"/\"default-dockercfg-jfdgs\"" Jul 07 19:09:15.678911 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.678890 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4"] Jul 07 19:09:15.689636 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.689615 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/1.log" Jul 07 19:09:15.700276 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.700253 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-dcpp6_fb656ed5-7f35-4160-9464-cdefb2ea022d/console-operator/2.log" Jul 07 19:09:15.831378 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.831332 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-sys\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.831378 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.831373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-proc\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.831571 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.831405 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-podres\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.831571 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.831469 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6gwg\" (UniqueName: \"kubernetes.io/projected/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-kube-api-access-w6gwg\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.831571 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.831521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-lib-modules\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.932199 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.932134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-sys\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.932199 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.932164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-proc\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.932199 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.932186 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-podres\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.932446 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.932219 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6gwg\" (UniqueName: \"kubernetes.io/projected/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-kube-api-access-w6gwg\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.932446 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.932258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-lib-modules\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.932446 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.932261 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-sys\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.932446 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.932304 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-proc\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.932446 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.932345 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-podres\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.932446 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.932416 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-lib-modules\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.942031 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.942008 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6gwg\" (UniqueName: \"kubernetes.io/projected/d9a932b9-4647-4077-b5d0-37dc4c8ef2e3-kube-api-access-w6gwg\") pod \"perf-node-gather-daemonset-686m4\" (UID: \"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3\") " pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:15.973063 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:15.973038 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:16.103042 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:16.103018 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4"] Jul 07 19:09:16.105627 ip-10-0-133-11 kubenswrapper[2582]: W0707 19:09:16.105600 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd9a932b9_4647_4077_b5d0_37dc4c8ef2e3.slice/crio-b5742034e6537ac06b9627bba905b7d97baff0fdf11c2ba9490d983d876c2858 WatchSource:0}: Error finding container b5742034e6537ac06b9627bba905b7d97baff0fdf11c2ba9490d983d876c2858: Status 404 returned error can't find the container with id b5742034e6537ac06b9627bba905b7d97baff0fdf11c2ba9490d983d876c2858 Jul 07 19:09:16.129414 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:16.129389 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" event={"ID":"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3","Type":"ContainerStarted","Data":"b5742034e6537ac06b9627bba905b7d97baff0fdf11c2ba9490d983d876c2858"} Jul 07 19:09:16.314135 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:16.314102 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-hgmd9_50e5cae2-5fbe-4e24-b94d-d922317bafd7/download-server/0.log" Jul 07 19:09:16.941795 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:16.941767 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-m55np_6ddc6e15-610a-43ef-bcbd-fc5b5401d876/volume-data-source-validator/0.log" Jul 07 19:09:17.135642 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:17.135608 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" event={"ID":"d9a932b9-4647-4077-b5d0-37dc4c8ef2e3","Type":"ContainerStarted","Data":"67e11cf4b2c0073a63d6b28ba0d78e29e4a68f53a1c86bec8db55a685ddb0af7"} Jul 07 19:09:17.135802 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:17.135665 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:17.155623 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:17.155571 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" podStartSLOduration=2.155556968 podStartE2EDuration="2.155556968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:17.154814587 +0000 UTC m=+1165.214262339" watchObservedRunningTime="2026-07-07 19:09:17.155556968 +0000 UTC m=+1165.215004719" Jul 07 19:09:18.125903 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:18.125874 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5nhx_3ba14cc4-ebe4-40ca-83e1-b6d89506ce86/dns/0.log" Jul 07 19:09:18.147178 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:18.147154 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5nhx_3ba14cc4-ebe4-40ca-83e1-b6d89506ce86/kube-rbac-proxy/0.log" Jul 07 19:09:18.171329 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:18.171304 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-67wwj_dc56a815-1801-4e5a-8fe8-14079115aa5d/dns-node-resolver/0.log" Jul 07 19:09:18.781341 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:18.781302 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d97f7f679-bwklk_f27c9c43-832e-4a31-9cd4-1d5195960c06/registry/0.log" Jul 07 19:09:18.828756 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:18.828728 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lrgzk_a5f19387-4025-44c1-a4d8-8ccc995ebd45/node-ca/0.log" Jul 07 19:09:20.029290 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:20.029260 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85b6b9f996-ktfxb_4215c973-8f45-40dc-9470-dd0e573e956f/kube-auth-proxy/0.log" Jul 07 19:09:20.057777 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:20.057751 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gt4g2_bc6ca085-cd2d-4644-9866-7ad5b4e15b2e/istio-proxy/0.log" Jul 07 19:09:20.087337 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:20.087299 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ccb877549-pms8p_b353dd5b-714f-4635-87b1-4577cdac4974/router/0.log" Jul 07 19:09:20.729602 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:20.729567 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7sql_364faadd-a345-4965-bef1-4b5e0bff06fd/serve-healthcheck-canary/0.log" Jul 07 19:09:21.241325 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:21.241296 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4l94p_27eb16aa-ceaa-403b-a255-bae1f23bf034/kube-rbac-proxy/0.log" Jul 07 19:09:21.263155 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:21.263132 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4l94p_27eb16aa-ceaa-403b-a255-bae1f23bf034/exporter/0.log" Jul 07 19:09:21.285207 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:21.285186 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4l94p_27eb16aa-ceaa-403b-a255-bae1f23bf034/extractor/0.log" Jul 07 19:09:23.150399 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:23.150374 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zqqk9/perf-node-gather-daemonset-686m4" Jul 07 19:09:23.616828 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:23.616802 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-m7dnt_83e23d62-c388-4dc1-a1ae-e2e6940b5dbd/manager/0.log" Jul 07 19:09:23.642925 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:23.642901 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ls8tl_006722ab-44d9-4c99-bb99-ee336d4d2932/manager/0.log" Jul 07 19:09:23.695193 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:23.695171 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nlv9v_f7c00999-8a91-49bd-b7f4-3517ab2ac8b5/server/0.log" Jul 07 19:09:23.758020 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:23.757995 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-b6j28_67f592e6-29e6-4cc9-8616-8a29a9fad7e1/manager/0.log" Jul 07 19:09:23.919323 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:23.919248 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf_341f2d94-e418-4e55-acb9-486db24453eb/manager/0.log" Jul 07 19:09:23.940013 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:23.939990 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6ffc4cd5-zdlnf_341f2d94-e418-4e55-acb9-486db24453eb/copy-manifests/0.log" Jul 07 19:09:25.212339 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:25.212307 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wz2s4_9e3b71d5-8a9a-411d-8fa0-7c9d9f6d1b8c/openshift-lws-operator/0.log" Jul 07 19:09:25.415443 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:25.415413 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85b6b9f996-ktfxb_4215c973-8f45-40dc-9470-dd0e573e956f/kube-auth-proxy/0.log" Jul 07 19:09:25.439196 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:25.439176 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gt4g2_bc6ca085-cd2d-4644-9866-7ad5b4e15b2e/istio-proxy/0.log" Jul 07 19:09:25.459812 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:25.459791 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ccb877549-pms8p_b353dd5b-714f-4635-87b1-4577cdac4974/router/0.log" Jul 07 19:09:26.771695 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:26.771665 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85b6b9f996-ktfxb_4215c973-8f45-40dc-9470-dd0e573e956f/kube-auth-proxy/0.log" Jul 07 19:09:26.796531 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:26.796502 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gt4g2_bc6ca085-cd2d-4644-9866-7ad5b4e15b2e/istio-proxy/0.log" Jul 07 19:09:26.816803 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:26.816743 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ccb877549-pms8p_b353dd5b-714f-4635-87b1-4577cdac4974/router/0.log" Jul 07 19:09:31.921620 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:31.921586 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7hr8b_05cfed71-5ed2-4f8d-bbcd-c3dbfaddc93e/kube-multus/0.log" Jul 07 19:09:31.951620 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:31.951591 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4wk8j_a1e008c7-4494-4cb3-98d4-7ea7e742eb8f/kube-multus-additional-cni-plugins/0.log" Jul 07 19:09:31.978774 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:31.978746 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4wk8j_a1e008c7-4494-4cb3-98d4-7ea7e742eb8f/egress-router-binary-copy/0.log" Jul 07 19:09:32.004023 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:32.003998 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4wk8j_a1e008c7-4494-4cb3-98d4-7ea7e742eb8f/cni-plugins/0.log" Jul 07 19:09:32.027713 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:32.027690 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4wk8j_a1e008c7-4494-4cb3-98d4-7ea7e742eb8f/bond-cni-plugin/0.log" Jul 07 19:09:32.050802 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:32.050781 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4wk8j_a1e008c7-4494-4cb3-98d4-7ea7e742eb8f/routeoverride-cni/0.log" Jul 07 19:09:32.075265 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:32.075244 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4wk8j_a1e008c7-4494-4cb3-98d4-7ea7e742eb8f/whereabouts-cni-bincopy/0.log" Jul 07 19:09:32.104194 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:32.104169 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4wk8j_a1e008c7-4494-4cb3-98d4-7ea7e742eb8f/whereabouts-cni/0.log" Jul 07 19:09:32.567693 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:32.567667 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bpz5n_4444bb12-3fdf-44c0-a2ff-fa21ff8556be/network-metrics-daemon/0.log" Jul 07 19:09:32.586309 ip-10-0-133-11 kubenswrapper[2582]: I0707 19:09:32.586285 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bpz5n_4444bb12-3fdf-44c0-a2ff-fa21ff8556be/kube-rbac-proxy/0.log"