Jul 01 19:20:18.922090 ip-10-0-131-235 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 19:20:18.922101 ip-10-0-131-235 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 19:20:18.922107 ip-10-0-131-235 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 19:20:18.922335 ip-10-0-131-235 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 19:20:29.070578 ip-10-0-131-235 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 19:20:29.070598 ip-10-0-131-235 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0465b229bcc54940b21906aa75e57576 -- Jul 01 19:22:34.780636 ip-10-0-131-235 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:22:35.231884 ip-10-0-131-235 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:35.231884 ip-10-0-131-235 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:22:35.231884 ip-10-0-131-235 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:35.231884 ip-10-0-131-235 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:22:35.231884 ip-10-0-131-235 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:35.234244 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.234126 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:22:35.240356 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240340 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:35.240356 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240368 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240372 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240375 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240379 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240382 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240385 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240388 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240391 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240393 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240396 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240398 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240401 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240403 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240406 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240408 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240411 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240413 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240416 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240418 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240421 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:35.240435 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240425 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240427 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240430 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240433 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240435 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240438 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240441 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240444 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240446 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240449 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240451 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240454 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240456 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240459 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240461 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240463 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240466 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240468 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240471 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240473 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:35.240898 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240475 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240478 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240480 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240483 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240485 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240488 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240490 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240492 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240495 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240497 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240499 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240502 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240504 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240507 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240510 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240513 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240518 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240522 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240524 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240528 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:35.241378 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240530 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240533 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240536 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240538 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240541 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240543 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240546 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240548 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240550 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240552 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240555 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240557 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240559 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240562 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240564 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240567 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240569 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240571 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240574 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240577 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:35.241871 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240579 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240582 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240584 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240587 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240591 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240595 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240599 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240602 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240605 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240608 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240611 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240614 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240616 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240619 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240621 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240624 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240626 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.240628 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241345 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241351 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:35.242346 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241354 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241372 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241375 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241378 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241380 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241383 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241386 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241388 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241391 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241394 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241396 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241399 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241401 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241404 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241406 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241409 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241412 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241415 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241418 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:35.242864 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241421 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241425 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241427 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241430 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241432 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241435 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241437 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241440 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241442 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241445 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241447 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241450 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241452 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241455 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241457 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241459 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241464 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241468 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241471 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241474 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:35.243392 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241477 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241479 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241483 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241486 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241489 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241491 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241494 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241497 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241499 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241502 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241505 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241508 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241510 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241513 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241516 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241518 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241521 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241523 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241525 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241528 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:35.243880 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241530 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241532 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241535 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241537 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241540 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241543 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241545 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241548 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241552 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241554 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241557 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241559 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241562 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241564 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241566 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241569 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241571 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241575 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241578 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:35.244398 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241581 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241584 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241587 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241590 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241593 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241595 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241597 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241601 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241603 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241606 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241609 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241611 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241614 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241616 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241619 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241621 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241623 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241626 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.241628 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242007 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242012 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:35.244873 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242014 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242017 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242020 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242024 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242027 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242030 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242032 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242035 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242038 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242040 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242044 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242048 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242051 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242054 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242056 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242059 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242061 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242066 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:35.245403 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242069 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242072 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242074 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242076 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242079 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242082 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242084 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242086 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242089 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242092 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242094 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242096 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242099 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242102 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242104 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242107 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242109 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242112 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242114 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242117 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:35.245838 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242119 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242122 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242125 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242127 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242130 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242132 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242135 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242137 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242140 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242142 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242145 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242148 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242151 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242154 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242156 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242159 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242161 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242164 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242166 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242168 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:35.246311 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242171 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242173 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242177 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242180 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242183 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242186 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242188 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242191 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242193 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242196 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242198 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242201 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242203 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242206 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242210 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242212 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242215 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242217 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242219 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242222 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:35.246805 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242224 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242226 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242229 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242233 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242236 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242238 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242241 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242244 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242246 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242249 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242251 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242253 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242256 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242259 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242261 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242264 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242266 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242269 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.242271 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242339 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242346 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:22:35.247276 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242352 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242374 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242381 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242386 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242390 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242395 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242399 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242401 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242405 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242408 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242411 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242414 2565 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242416 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242419 2565 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242423 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242426 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242434 2565 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242437 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242440 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242443 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242446 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242450 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242453 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:22:35.247842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242456 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242459 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242462 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242464 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242467 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242470 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242473 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242477 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242479 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242482 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242485 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242487 2565 flags.go:64] FLAG: --enable-server="true" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242490 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242495 2565 flags.go:64] FLAG: --event-burst="100" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242498 2565 flags.go:64] FLAG: --event-qps="50" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242501 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242504 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242507 2565 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242510 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242513 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242516 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242518 2565 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242521 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242526 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242529 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:22:35.248404 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242532 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242535 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242538 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242541 2565 flags.go:64] FLAG: --feature-gates="" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242544 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242547 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242550 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242553 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242556 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242559 2565 flags.go:64] FLAG: --help="false" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242562 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242565 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242568 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242570 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242574 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242577 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242579 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242582 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242585 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242588 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242591 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242594 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242597 2565 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242599 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:22:35.249035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242602 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242605 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242608 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242610 2565 flags.go:64] FLAG: --lock-file="" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242613 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242616 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242620 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242626 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242628 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242631 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242633 2565 flags.go:64] FLAG: --logging-format="text" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242636 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242640 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242642 2565 flags.go:64] FLAG: --manifest-url="" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242645 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242649 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242652 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242656 2565 flags.go:64] FLAG: --max-pods="110" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242658 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242661 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242664 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242666 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242669 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242672 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242675 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:22:35.249628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242681 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242685 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242687 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242690 2565 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242693 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242698 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242701 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242704 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242706 2565 flags.go:64] FLAG: --port="10250" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242709 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242712 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bc15609043d812c6" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242715 2565 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242717 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242722 2565 flags.go:64] FLAG: --register-node="true" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242724 2565 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242728 2565 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242731 2565 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242733 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242736 2565 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242739 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242743 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242745 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242748 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242751 2565 flags.go:64] FLAG: --runonce="false" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242753 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:22:35.250224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242756 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242759 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242761 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242764 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242766 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242769 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242773 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242776 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242778 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242781 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242784 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242787 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242790 2565 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242793 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242798 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242801 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242804 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242808 2565 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242811 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242813 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242817 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242819 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242822 2565 flags.go:64] FLAG: --v="2" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242826 2565 flags.go:64] FLAG: --version="false" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242829 2565 flags.go:64] FLAG: --vmodule="" Jul 01 19:22:35.250883 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242833 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.242836 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243914 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243920 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243923 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243926 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243929 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243932 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243934 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243937 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243940 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243942 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243944 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243949 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243951 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243954 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243956 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243959 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243962 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243964 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:35.251833 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243967 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243970 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243972 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243974 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243977 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243979 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243981 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243985 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243987 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243989 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243993 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243995 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.243997 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244000 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244002 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244005 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244008 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244010 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244012 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244015 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:35.252426 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244017 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244020 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244022 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244025 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244027 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244031 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244034 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244036 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244039 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244041 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244044 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244046 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244048 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244051 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244053 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244056 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244059 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244062 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244064 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244067 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:35.252912 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244069 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244071 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244074 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244076 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244079 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244081 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244083 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244086 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244088 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244091 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244094 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244097 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244101 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244104 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244107 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244109 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244112 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244116 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244119 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:35.253489 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244121 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244124 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244126 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244129 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244132 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244136 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244139 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244142 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244144 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244147 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244149 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244153 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244156 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244159 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244161 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244164 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244167 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244169 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244172 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:35.253944 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244174 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:35.254409 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244177 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:35.254409 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.244179 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:35.254409 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.244184 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:35.254409 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.254216 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:22:35.254409 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.254231 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:22:35.255458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.255447 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:22:35.255496 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.255462 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:22:35.255526 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255520 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:35.255526 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255525 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255528 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255531 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255535 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255539 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255542 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255545 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255548 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255550 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255553 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255556 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255559 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255561 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255564 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255566 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255569 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255571 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255574 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255577 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255579 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:35.255578 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255582 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255585 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255588 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255591 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255599 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255601 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255604 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255606 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255608 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255611 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255614 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255617 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255619 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255622 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255624 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255627 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255629 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255631 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255634 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:35.256088 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255636 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255639 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255641 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255643 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255646 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255648 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255652 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255656 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255659 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255662 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255665 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255668 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255670 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255673 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255675 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255679 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255682 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255686 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255689 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:35.256580 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255692 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255695 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255697 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255700 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255703 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255706 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255709 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255711 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255714 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255717 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255719 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255722 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255724 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255727 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255729 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255732 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255734 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255737 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255739 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255742 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:35.257023 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255745 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255748 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255750 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255752 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255755 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255758 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255760 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255762 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255766 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255768 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255771 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255773 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255776 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255778 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255781 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255783 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255786 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255788 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255790 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:35.257506 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255793 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.255798 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255913 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255917 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255920 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255923 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255926 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255929 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255931 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255934 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255936 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255939 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255941 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255944 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255947 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:35.257962 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255950 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255952 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255955 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255958 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255961 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255964 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255967 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255970 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255972 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255975 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255977 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255980 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255982 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255985 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255987 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255989 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255992 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255994 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255997 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.255999 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:35.258312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256001 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256003 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256006 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256008 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256011 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256013 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256015 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256018 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256020 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256024 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256027 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256029 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256033 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256037 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256040 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256042 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256045 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256047 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256050 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256052 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:35.258798 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256055 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256057 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256060 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256062 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256064 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256067 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256069 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256072 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256074 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256076 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256079 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256081 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256083 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256086 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256088 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256091 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256093 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256096 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256098 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:35.259266 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256101 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256104 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256106 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256108 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256111 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256113 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256117 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256120 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256122 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256126 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256128 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256131 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256133 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256135 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256139 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256142 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256145 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256148 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256150 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:35.259837 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256152 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256155 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256157 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256159 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256162 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256164 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256167 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:35.256169 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.256174 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.256280 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:22:35.260298 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.259452 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:22:35.261970 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.261949 2565 server.go:1019] "Starting client certificate rotation" Jul 01 19:22:35.262079 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.262061 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:22:35.262119 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.262099 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:22:35.265135 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.265122 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:22:35.266249 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.266233 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:22:35.282651 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.282633 2565 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:22:35.284777 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.284764 2565 log.go:25] "Validated CRI v1 image API" Jul 01 19:22:35.286287 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.286266 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:22:35.289344 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.289326 2565 fs.go:135] Filesystem UUIDs: map[581f607f-8dcb-4692-9779-f6352ae912bd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e47a34e3-095c-499c-8455-93185a425efb:/dev/nvme0n1p3] Jul 01 19:22:35.289423 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.289345 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:22:35.292933 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.292914 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:22:35.296918 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.295904 2565 manager.go:216] Machine: {Timestamp:2026-07-01 19:22:35.293572681 +0000 UTC m=+0.380308532 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099007 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25a24be3d99b424cc86a50c41528db SystemUUID:ec25a24b-e3d9-9b42-4cc8-6a50c41528db BootID:0465b229-bcc5-4940-b219-06aa75e57576 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:89:b7:f5:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:89:b7:f5:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:7c:c6:98:21:3a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:22:35.296918 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.296904 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:22:35.297089 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.297044 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:22:35.302055 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.301879 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:22:35.302183 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.302059 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:22:35.303020 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.303009 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:22:35.303052 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.303023 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:22:35.303052 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.303031 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:22:35.303969 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.303959 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:22:35.304753 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.304744 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:22:35.308169 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.308159 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:22:35.308284 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.308274 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:22:35.308315 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.308304 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:22:35.308315 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.308314 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:22:35.308382 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.308331 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:22:35.308382 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.308341 2565 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:22:35.308382 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.308349 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:22:35.308770 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.308757 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:22:35.308807 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.308784 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:22:35.311332 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.311315 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:22:35.312909 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.312897 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:22:35.312962 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.312928 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:22:35.313694 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313683 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:22:35.313733 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313700 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:22:35.313733 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313707 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:22:35.313733 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313713 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:22:35.313733 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313720 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:22:35.313733 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313726 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:22:35.313932 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313923 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:22:35.313960 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313933 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:22:35.313960 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313939 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:22:35.313960 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313945 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:22:35.313960 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313953 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:22:35.313960 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.313961 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:22:35.315118 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.315108 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:22:35.315149 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.315118 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:22:35.318531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.318518 2565 server.go:1268] "Started kubelet" Jul 01 19:22:35.318718 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.318656 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:22:35.318805 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.318753 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:22:35.318805 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.318750 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:22:35.319493 ip-10-0-131-235 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:22:35.319729 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.319557 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-648k2" Jul 01 19:22:35.320051 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.319877 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:22:35.320051 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.319877 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:22:35.320051 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.319904 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:22:35.320976 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.320961 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:22:35.322754 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.322738 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:22:35.322912 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.322892 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:22:35.326628 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.326613 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-648k2" Jul 01 19:22:35.329374 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.327834 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-235.ec2.internal.18be40cdd7cfcaae default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-235.ec2.internal,UID:ip-10-0-131-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-235.ec2.internal,},FirstTimestamp:2026-07-01 19:22:35.318487726 +0000 UTC m=+0.405223583,LastTimestamp:2026-07-01 19:22:35.318487726 +0000 UTC m=+0.405223583,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-235.ec2.internal,}" Jul 01 19:22:35.330444 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.330426 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:22:35.330528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.330443 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:22:35.330528 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.330519 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:35.331394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.331249 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:22:35.331394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.331248 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:22:35.331394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.331268 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:22:35.331394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.331381 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:22:35.331394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.331393 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:22:35.332098 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.332078 2565 factory.go:55] Registering systemd factory Jul 01 19:22:35.332182 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.332124 2565 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:22:35.333594 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.332955 2565 factory.go:153] Registering CRI-O factory Jul 01 19:22:35.333594 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.332971 2565 factory.go:223] Registration of the crio container factory successfully Jul 01 19:22:35.333594 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.333041 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:22:35.333594 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.333062 2565 factory.go:103] Registering Raw factory Jul 01 19:22:35.333594 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.333083 2565 manager.go:1196] Started watching for new ooms in manager Jul 01 19:22:35.333594 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.333550 2565 manager.go:349] Starting recovery of all containers Jul 01 19:22:35.334972 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.334945 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:35.340266 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.340233 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-235.ec2.internal\" not found" node="ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.346243 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.346226 2565 manager.go:354] Recovery completed Jul 01 19:22:35.350157 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.350141 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:35.352550 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.352530 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:35.352610 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.352566 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:35.352610 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.352579 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:35.353081 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.353067 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:22:35.353081 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.353081 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:35.353188 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.353080 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:22:35.353188 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.353110 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:22:35.353738 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.353724 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:35.353804 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.353752 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:35.353804 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.353765 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:35.354519 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.354507 2565 policy_none.go:49] "None policy: Start" Jul 01 19:22:35.354558 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.354540 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:22:35.354558 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.354550 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:22:35.355954 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.355943 2565 policy_none.go:47] "Start" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.401886 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.402990 2565 manager.go:337] "Starting Device Plugin manager" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.403014 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.403025 2565 server.go:87] "Starting device plugin registration server" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.403242 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.403262 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.403259 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.403299 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.403322 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.403398 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.403405 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.403486 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.403499 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.404749 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.404790 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:35.410458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.406033 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:35.503665 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.503639 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:35.503665 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.503660 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal"] Jul 01 19:22:35.503838 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.503771 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:35.504709 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.504694 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:35.504709 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.504704 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:35.504861 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.504725 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:35.504861 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.504729 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:35.504861 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.504751 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:35.504861 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.504754 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:35.504861 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.504799 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.506606 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.506593 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:35.506760 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.506747 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.506798 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.506785 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:35.507221 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.507206 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:35.507221 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.507227 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:35.507353 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.507208 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:35.507353 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.507258 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:35.507353 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.507278 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:35.507353 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.507242 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:35.508569 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.508553 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.508650 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.508584 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:35.509201 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.509184 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:35.509278 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.509216 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:35.509278 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.509235 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:35.515429 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.515416 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.515484 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.515435 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-235.ec2.internal\": node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:35.533054 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.533035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/84db88ff65cf2a1e02da1c0d3c21d266-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal\" (UID: \"84db88ff65cf2a1e02da1c0d3c21d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.533119 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.533060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84db88ff65cf2a1e02da1c0d3c21d266-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal\" (UID: \"84db88ff65cf2a1e02da1c0d3c21d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.533119 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.533077 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/847db0cc99df2dba82bff072bfa78f80-config\") pod \"kube-apiserver-proxy-ip-10-0-131-235.ec2.internal\" (UID: \"847db0cc99df2dba82bff072bfa78f80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.543054 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.543027 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-235.ec2.internal\" not found" node="ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.546555 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.546538 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-235.ec2.internal\" not found" node="ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.548894 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.548876 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:35.633452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.633422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/84db88ff65cf2a1e02da1c0d3c21d266-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal\" (UID: \"84db88ff65cf2a1e02da1c0d3c21d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.633452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.633452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84db88ff65cf2a1e02da1c0d3c21d266-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal\" (UID: \"84db88ff65cf2a1e02da1c0d3c21d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.633616 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.633468 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/847db0cc99df2dba82bff072bfa78f80-config\") pod \"kube-apiserver-proxy-ip-10-0-131-235.ec2.internal\" (UID: \"847db0cc99df2dba82bff072bfa78f80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.633616 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.633516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84db88ff65cf2a1e02da1c0d3c21d266-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal\" (UID: \"84db88ff65cf2a1e02da1c0d3c21d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.633616 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.633524 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/84db88ff65cf2a1e02da1c0d3c21d266-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal\" (UID: \"84db88ff65cf2a1e02da1c0d3c21d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.633616 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.633570 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/847db0cc99df2dba82bff072bfa78f80-config\") pod \"kube-apiserver-proxy-ip-10-0-131-235.ec2.internal\" (UID: \"847db0cc99df2dba82bff072bfa78f80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.649750 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.649723 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:35.750370 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.750336 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:35.846135 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.846068 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.850116 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:35.849984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal" Jul 01 19:22:35.851058 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.851042 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:35.951778 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:35.951749 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.052633 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:36.052603 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.153810 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:36.153730 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.253915 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:36.253887 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.260542 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.260520 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:22:36.260709 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.260688 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:22:36.260749 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.260688 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:22:36.332538 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.332490 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:17:36 +0000 UTC" deadline="2027-11-26 02:39:49.274862014 +0000 UTC" Jul 01 19:22:36.332538 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.332529 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12295h17m12.942336566s" Jul 01 19:22:36.354967 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:36.354937 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.455974 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:36.455937 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.523941 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.523894 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:36.542791 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:36.542754 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84db88ff65cf2a1e02da1c0d3c21d266.slice/crio-644a80571d8aed8401492f5c516f16491e0c9609a630f0423f5e31c8a4515102 WatchSource:0}: Error finding container 644a80571d8aed8401492f5c516f16491e0c9609a630f0423f5e31c8a4515102: Status 404 returned error can't find the container with id 644a80571d8aed8401492f5c516f16491e0c9609a630f0423f5e31c8a4515102 Jul 01 19:22:36.546794 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:36.546771 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847db0cc99df2dba82bff072bfa78f80.slice/crio-93685ba7ec2dac88b9e5cf9ae478bd0cdf2fe6285723eb5439ae89e86b742618 WatchSource:0}: Error finding container 93685ba7ec2dac88b9e5cf9ae478bd0cdf2fe6285723eb5439ae89e86b742618: Status 404 returned error can't find the container with id 93685ba7ec2dac88b9e5cf9ae478bd0cdf2fe6285723eb5439ae89e86b742618 Jul 01 19:22:36.548551 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.548520 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:22:36.557034 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:36.557013 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.657198 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:36.657156 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.758283 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:36.758253 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.859553 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:36.859504 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-235.ec2.internal\" not found" Jul 01 19:22:36.891237 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.891215 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:36.933422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.933385 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal" Jul 01 19:22:36.947261 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.947242 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:22:36.948455 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.948432 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" Jul 01 19:22:36.960153 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:36.960127 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:22:37.139987 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.139919 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:37.309060 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.309030 2565 apiserver.go:52] "Watching apiserver" Jul 01 19:22:37.315515 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.315481 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:22:37.315921 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.315896 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-v5wqc","openshift-ovn-kubernetes/ovnkube-node-kpjdc","kube-system/konnectivity-agent-mmnqc","openshift-dns/node-resolver-f6c4k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal","openshift-multus/multus-7dcjg","openshift-multus/multus-additional-cni-plugins-kwlqs","openshift-multus/network-metrics-daemon-rh76h","openshift-network-diagnostics/network-check-target-vw4mh","openshift-network-operator/iptables-alerter-m7lb5","kube-system/global-pull-secret-syncer-qvdtj","kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg","openshift-cluster-node-tuning-operator/tuned-hmssg"] Jul 01 19:22:37.317831 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.317807 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.319096 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.319074 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.319267 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.319238 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:37.320450 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.320426 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:22:37.320659 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.320638 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:22:37.320743 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.320641 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:22:37.321098 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.321075 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:22:37.321200 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.321131 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bs7rx\"" Jul 01 19:22:37.321200 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.321075 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:22:37.321200 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.321080 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:22:37.321919 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.321900 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.323695 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.323270 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.324710 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.324683 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:22:37.324869 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.324851 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:22:37.325016 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.324994 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:22:37.325270 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.325249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.326167 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.326151 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qsng4\"" Jul 01 19:22:37.326408 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.326388 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:22:37.326718 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.326698 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g9s5d\"" Jul 01 19:22:37.326860 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.326842 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:37.326932 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.326902 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:37.330538 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.329344 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:22:37.330538 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.329729 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h92cw\"" Jul 01 19:22:37.331516 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.331490 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:22:37.332531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.332505 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:22:37.332719 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.332699 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:22:37.332892 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.332875 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.333871 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.333735 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fppgt\"" Jul 01 19:22:37.334719 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.334695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.336324 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.336301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.338212 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.337475 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7sgsx\"" Jul 01 19:22:37.338212 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.337684 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:22:37.338212 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.338006 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:22:37.338212 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.338054 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:22:37.338558 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.338259 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.338752 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.338737 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:22:37.339001 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.338982 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:22:37.339093 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339004 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:22:37.339194 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339130 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:22:37.339194 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339182 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:22:37.339310 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339292 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p9ptj\"" Jul 01 19:22:37.339420 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339402 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:22:37.339848 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339498 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:22:37.339937 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339504 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:22:37.339993 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339548 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:22:37.340049 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339705 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wqchf\"" Jul 01 19:22:37.340108 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.339757 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:37.340380 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.340139 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:37.341717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.341700 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:22:37.341847 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.341761 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:22:37.342011 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.341989 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:22:37.342125 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342105 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m7qcw\"" Jul 01 19:22:37.342723 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:37.342817 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-sysconfig\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.342817 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0928bd05-a7e2-4498-bdaf-a70c08b988a0-ovnkube-config\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.342817 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342772 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-etc-kubernetes\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.342817 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-var-lib-kubelet\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.343005 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-kubelet\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.343005 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-run-openvswitch\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.343005 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.343005 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0928bd05-a7e2-4498-bdaf-a70c08b988a0-ovnkube-script-lib\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.343005 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.342998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7dffa21-9e3e-4c53-9a39-4bec05893e52-cni-binary-copy\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.343218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.343218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b7dffa21-9e3e-4c53-9a39-4bec05893e52-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.343218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd-agent-certs\") pod \"konnectivity-agent-mmnqc\" (UID: \"03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd\") " pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:22:37.343218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-kubernetes\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.343218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b7dffa21-9e3e-4c53-9a39-4bec05893e52-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.343218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-var-lib-kubelet\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.343218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-socket-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-run-systemd\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-run-ovn\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56xsx\" (UniqueName: \"kubernetes.io/projected/93615ebb-d773-4a72-94fe-10aadb4187a5-kube-api-access-56xsx\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-systemd\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-os-release\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ad5feee-db3d-494d-b5d9-676907e21fa0-hosts-file\") pod \"node-resolver-f6c4k\" (UID: \"1ad5feee-db3d-494d-b5d9-676907e21fa0\") " pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343405 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-sysctl-conf\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-run\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-host\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.343528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pwmn\" (UniqueName: \"kubernetes.io/projected/b0814bbe-f4c2-4088-90d0-286a484bb30f-kube-api-access-5pwmn\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-systemd-units\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343606 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-cni-dir\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-sys\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-slash\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343693 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ad5feee-db3d-494d-b5d9-676907e21fa0-tmp-dir\") pod \"node-resolver-f6c4k\" (UID: \"1ad5feee-db3d-494d-b5d9-676907e21fa0\") " pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343733 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93615ebb-d773-4a72-94fe-10aadb4187a5-cni-binary-copy\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343773 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-lib-modules\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0928bd05-a7e2-4498-bdaf-a70c08b988a0-ovn-node-metrics-cert\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-system-cni-dir\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343873 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-registration-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-etc-openvswitch\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9484aaf-f96b-44f2-b188-e15736f70dc9-kubelet-config\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.344000 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.343988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-run-netns\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-hostroot\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-sysctl-d\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-run-netns\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-node-log\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z2hm\" (UniqueName: \"kubernetes.io/projected/b7dffa21-9e3e-4c53-9a39-4bec05893e52-kube-api-access-2z2hm\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-cnibin\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-sys-fs\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-cnibin\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9484aaf-f96b-44f2-b188-e15736f70dc9-dbus\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-tmp\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l8n8\" (UniqueName: \"kubernetes.io/projected/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-kube-api-access-4l8n8\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-etc-selinux\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-var-lib-openvswitch\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-cni-netd\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344393 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j79m\" (UniqueName: \"kubernetes.io/projected/1ad5feee-db3d-494d-b5d9-676907e21fa0-kube-api-access-8j79m\") pod \"node-resolver-f6c4k\" (UID: \"1ad5feee-db3d-494d-b5d9-676907e21fa0\") " pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.344728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-run-k8s-cni-cncf-io\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-run-multus-certs\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd-konnectivity-ca\") pod \"konnectivity-agent-mmnqc\" (UID: \"03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd\") " pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpjvg\" (UniqueName: \"kubernetes.io/projected/0928bd05-a7e2-4498-bdaf-a70c08b988a0-kube-api-access-dpjvg\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-os-release\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-socket-dir-parent\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-daemon-config\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-conf-dir\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-tuned\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-log-socket\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344624 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-cni-bin\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344648 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-system-cni-dir\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-modprobe-d\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-device-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0928bd05-a7e2-4498-bdaf-a70c08b988a0-env-overrides\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.345196 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-var-lib-cni-bin\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.345893 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.344742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-var-lib-cni-multus\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.353258 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.353220 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:22:37.380212 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.380174 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lsmlf" Jul 01 19:22:37.392565 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.392510 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lsmlf" Jul 01 19:22:37.411218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.411151 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal" event={"ID":"847db0cc99df2dba82bff072bfa78f80","Type":"ContainerStarted","Data":"93685ba7ec2dac88b9e5cf9ae478bd0cdf2fe6285723eb5439ae89e86b742618"} Jul 01 19:22:37.412486 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.412450 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" event={"ID":"84db88ff65cf2a1e02da1c0d3c21d266","Type":"ContainerStarted","Data":"644a80571d8aed8401492f5c516f16491e0c9609a630f0423f5e31c8a4515102"} Jul 01 19:22:37.432736 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.432705 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:22:37.445543 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-var-lib-cni-bin\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.445691 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-var-lib-cni-multus\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.445691 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445631 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-var-lib-cni-multus\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.445691 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445631 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-var-lib-cni-bin\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.445691 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:37.445691 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-sysconfig\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0928bd05-a7e2-4498-bdaf-a70c08b988a0-ovnkube-config\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445774 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-etc-kubernetes\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-var-lib-kubelet\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445794 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-sysconfig\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445820 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-kubelet\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445860 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-var-lib-kubelet\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445867 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-kubelet\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445868 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-etc-kubernetes\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445895 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-run-openvswitch\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.445947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445925 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0928bd05-a7e2-4498-bdaf-a70c08b988a0-ovnkube-script-lib\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-run-openvswitch\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.445981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7dffa21-9e3e-4c53-9a39-4bec05893e52-cni-binary-copy\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b7dffa21-9e3e-4c53-9a39-4bec05893e52-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd-agent-certs\") pod \"konnectivity-agent-mmnqc\" (UID: \"03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd\") " pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-kubernetes\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b7dffa21-9e3e-4c53-9a39-4bec05893e52-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446190 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-var-lib-kubelet\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-socket-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446218 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-run-systemd\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-run-ovn\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446277 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-kubernetes\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91579e6e-91eb-49bc-8bee-85ac55c7c80a-iptables-alerter-script\") pod \"iptables-alerter-m7lb5\" (UID: \"91579e6e-91eb-49bc-8bee-85ac55c7c80a\") " pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.446540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56xsx\" (UniqueName: \"kubernetes.io/projected/93615ebb-d773-4a72-94fe-10aadb4187a5-kube-api-access-56xsx\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446346 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-systemd\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446374 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-os-release\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ad5feee-db3d-494d-b5d9-676907e21fa0-hosts-file\") pod \"node-resolver-f6c4k\" (UID: \"1ad5feee-db3d-494d-b5d9-676907e21fa0\") " pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-sysctl-conf\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446448 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0928bd05-a7e2-4498-bdaf-a70c08b988a0-ovnkube-config\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-run\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446499 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-host\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pwmn\" (UniqueName: \"kubernetes.io/projected/b0814bbe-f4c2-4088-90d0-286a484bb30f-kube-api-access-5pwmn\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-systemd-units\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-cni-dir\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0928bd05-a7e2-4498-bdaf-a70c08b988a0-ovnkube-script-lib\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446630 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-run-systemd\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446617 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7dffa21-9e3e-4c53-9a39-4bec05893e52-cni-binary-copy\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-sys\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446670 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-host\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-systemd-units\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.447422 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-slash\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b7dffa21-9e3e-4c53-9a39-4bec05893e52-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8675\" (UniqueName: \"kubernetes.io/projected/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-kube-api-access-d8675\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ad5feee-db3d-494d-b5d9-676907e21fa0-tmp-dir\") pod \"node-resolver-f6c4k\" (UID: \"1ad5feee-db3d-494d-b5d9-676907e21fa0\") " pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446771 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-socket-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93615ebb-d773-4a72-94fe-10aadb4187a5-cni-binary-copy\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-lib-modules\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446867 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-os-release\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0928bd05-a7e2-4498-bdaf-a70c08b988a0-ovn-node-metrics-cert\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-lib-modules\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-system-cni-dir\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446949 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446962 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446984 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446993 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-registration-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-cni-dir\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-etc-openvswitch\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.448522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/400fbd2a-170e-4079-bd8e-b16907259376-host\") pod \"node-ca-v5wqc\" (UID: \"400fbd2a-170e-4079-bd8e-b16907259376\") " pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-sysctl-conf\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447133 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9484aaf-f96b-44f2-b188-e15736f70dc9-kubelet-config\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447145 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ad5feee-db3d-494d-b5d9-676907e21fa0-hosts-file\") pod \"node-resolver-f6c4k\" (UID: \"1ad5feee-db3d-494d-b5d9-676907e21fa0\") " pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.446580 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-var-lib-kubelet\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9484aaf-f96b-44f2-b188-e15736f70dc9-kubelet-config\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447188 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-system-cni-dir\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447189 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-run\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447216 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-etc-openvswitch\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-run-netns\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-hostroot\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-run-ovn\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-sysctl-d\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447296 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-slash\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447306 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-run-netns\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447313 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93615ebb-d773-4a72-94fe-10aadb4187a5-cni-binary-copy\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-node-log\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447359 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-run-netns\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.449255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447372 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z2hm\" (UniqueName: \"kubernetes.io/projected/b7dffa21-9e3e-4c53-9a39-4bec05893e52-kube-api-access-2z2hm\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447384 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-systemd\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-cnibin\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447462 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b7dffa21-9e3e-4c53-9a39-4bec05893e52-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-cnibin\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.447502 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447527 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-sys\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.447573 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret podName:a9484aaf-f96b-44f2-b188-e15736f70dc9 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:37.947554384 +0000 UTC m=+3.034290224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret") pod "global-pull-secret-syncer-qvdtj" (UID: "a9484aaf-f96b-44f2-b188-e15736f70dc9") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447147 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-registration-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-hostroot\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-sysctl-d\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447754 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ad5feee-db3d-494d-b5d9-676907e21fa0-tmp-dir\") pod \"node-resolver-f6c4k\" (UID: \"1ad5feee-db3d-494d-b5d9-676907e21fa0\") " pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447772 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-run-netns\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-sys-fs\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447815 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-node-log\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-cnibin\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9484aaf-f96b-44f2-b188-e15736f70dc9-dbus\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.450034 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447888 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-tmp\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l8n8\" (UniqueName: \"kubernetes.io/projected/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-kube-api-access-4l8n8\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-etc-selinux\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-var-lib-openvswitch\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447966 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7dffa21-9e3e-4c53-9a39-4bec05893e52-cnibin\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.447984 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-cni-netd\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j79m\" (UniqueName: \"kubernetes.io/projected/1ad5feee-db3d-494d-b5d9-676907e21fa0-kube-api-access-8j79m\") pod \"node-resolver-f6c4k\" (UID: \"1ad5feee-db3d-494d-b5d9-676907e21fa0\") " pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-sys-fs\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-run-k8s-cni-cncf-io\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-run-multus-certs\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448070 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9484aaf-f96b-44f2-b188-e15736f70dc9-dbus\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd-konnectivity-ca\") pod \"konnectivity-agent-mmnqc\" (UID: \"03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd\") " pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448103 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-run-k8s-cni-cncf-io\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448111 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpjvg\" (UniqueName: \"kubernetes.io/projected/0928bd05-a7e2-4498-bdaf-a70c08b988a0-kube-api-access-dpjvg\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448136 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-cni-netd\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5z5n\" (UniqueName: \"kubernetes.io/projected/91579e6e-91eb-49bc-8bee-85ac55c7c80a-kube-api-access-k5z5n\") pod \"iptables-alerter-m7lb5\" (UID: \"91579e6e-91eb-49bc-8bee-85ac55c7c80a\") " pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/400fbd2a-170e-4079-bd8e-b16907259376-serviceca\") pod \"node-ca-v5wqc\" (UID: \"400fbd2a-170e-4079-bd8e-b16907259376\") " pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.450702 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448188 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-os-release\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-socket-dir-parent\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-daemon-config\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh7qf\" (UniqueName: \"kubernetes.io/projected/400fbd2a-170e-4079-bd8e-b16907259376-kube-api-access-rh7qf\") pod \"node-ca-v5wqc\" (UID: \"400fbd2a-170e-4079-bd8e-b16907259376\") " pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448315 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-etc-selinux\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-conf-dir\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-tuned\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-log-socket\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-cni-bin\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448440 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-os-release\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448492 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91579e6e-91eb-49bc-8bee-85ac55c7c80a-host-slash\") pod \"iptables-alerter-m7lb5\" (UID: \"91579e6e-91eb-49bc-8bee-85ac55c7c80a\") " pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-system-cni-dir\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448589 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-system-cni-dir\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448643 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448655 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-modprobe-d\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-device-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.451531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448705 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-conf-dir\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0928bd05-a7e2-4498-bdaf-a70c08b988a0-env-overrides\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd-konnectivity-ca\") pod \"konnectivity-agent-mmnqc\" (UID: \"03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd\") " pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-var-lib-openvswitch\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448835 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-daemon-config\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-multus-socket-dir-parent\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93615ebb-d773-4a72-94fe-10aadb4187a5-host-run-multus-certs\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.448991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0814bbe-f4c2-4088-90d0-286a484bb30f-device-dir\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.449017 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-host-cni-bin\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.449029 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0928bd05-a7e2-4498-bdaf-a70c08b988a0-log-socket\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.449045 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-modprobe-d\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.449150 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0928bd05-a7e2-4498-bdaf-a70c08b988a0-env-overrides\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.451327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-etc-tuned\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.451391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-tmp\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.451744 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd-agent-certs\") pod \"konnectivity-agent-mmnqc\" (UID: \"03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd\") " pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:22:37.452410 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.452089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0928bd05-a7e2-4498-bdaf-a70c08b988a0-ovn-node-metrics-cert\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.458726 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.458686 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:37.458852 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.458763 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:37.458852 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.458780 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8bfg5 for pod openshift-network-diagnostics/network-check-target-vw4mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:37.458977 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.458890 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5 podName:20ac655e-bd97-431c-86ff-5af517032e3d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:37.958869773 +0000 UTC m=+3.045605633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8bfg5" (UniqueName: "kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5") pod "network-check-target-vw4mh" (UID: "20ac655e-bd97-431c-86ff-5af517032e3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:37.461649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.461628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z2hm\" (UniqueName: \"kubernetes.io/projected/b7dffa21-9e3e-4c53-9a39-4bec05893e52-kube-api-access-2z2hm\") pod \"multus-additional-cni-plugins-kwlqs\" (UID: \"b7dffa21-9e3e-4c53-9a39-4bec05893e52\") " pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.461857 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.461839 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pwmn\" (UniqueName: \"kubernetes.io/projected/b0814bbe-f4c2-4088-90d0-286a484bb30f-kube-api-access-5pwmn\") pod \"aws-ebs-csi-driver-node-ff2hg\" (UID: \"b0814bbe-f4c2-4088-90d0-286a484bb30f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.467711 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.467686 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpjvg\" (UniqueName: \"kubernetes.io/projected/0928bd05-a7e2-4498-bdaf-a70c08b988a0-kube-api-access-dpjvg\") pod \"ovnkube-node-kpjdc\" (UID: \"0928bd05-a7e2-4498-bdaf-a70c08b988a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.470079 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.470052 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56xsx\" (UniqueName: \"kubernetes.io/projected/93615ebb-d773-4a72-94fe-10aadb4187a5-kube-api-access-56xsx\") pod \"multus-7dcjg\" (UID: \"93615ebb-d773-4a72-94fe-10aadb4187a5\") " pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.470670 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.470645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j79m\" (UniqueName: \"kubernetes.io/projected/1ad5feee-db3d-494d-b5d9-676907e21fa0-kube-api-access-8j79m\") pod \"node-resolver-f6c4k\" (UID: \"1ad5feee-db3d-494d-b5d9-676907e21fa0\") " pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.471118 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.471073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l8n8\" (UniqueName: \"kubernetes.io/projected/313478e1-ca7a-4a90-abc1-d0a8f486a0ff-kube-api-access-4l8n8\") pod \"tuned-hmssg\" (UID: \"313478e1-ca7a-4a90-abc1-d0a8f486a0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.549457 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91579e6e-91eb-49bc-8bee-85ac55c7c80a-iptables-alerter-script\") pod \"iptables-alerter-m7lb5\" (UID: \"91579e6e-91eb-49bc-8bee-85ac55c7c80a\") " pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.549649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8675\" (UniqueName: \"kubernetes.io/projected/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-kube-api-access-d8675\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:37.549649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/400fbd2a-170e-4079-bd8e-b16907259376-host\") pod \"node-ca-v5wqc\" (UID: \"400fbd2a-170e-4079-bd8e-b16907259376\") " pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.549649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549569 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5z5n\" (UniqueName: \"kubernetes.io/projected/91579e6e-91eb-49bc-8bee-85ac55c7c80a-kube-api-access-k5z5n\") pod \"iptables-alerter-m7lb5\" (UID: \"91579e6e-91eb-49bc-8bee-85ac55c7c80a\") " pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.549649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/400fbd2a-170e-4079-bd8e-b16907259376-serviceca\") pod \"node-ca-v5wqc\" (UID: \"400fbd2a-170e-4079-bd8e-b16907259376\") " pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.549649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549636 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/400fbd2a-170e-4079-bd8e-b16907259376-host\") pod \"node-ca-v5wqc\" (UID: \"400fbd2a-170e-4079-bd8e-b16907259376\") " pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.549911 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh7qf\" (UniqueName: \"kubernetes.io/projected/400fbd2a-170e-4079-bd8e-b16907259376-kube-api-access-rh7qf\") pod \"node-ca-v5wqc\" (UID: \"400fbd2a-170e-4079-bd8e-b16907259376\") " pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.549911 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91579e6e-91eb-49bc-8bee-85ac55c7c80a-host-slash\") pod \"iptables-alerter-m7lb5\" (UID: \"91579e6e-91eb-49bc-8bee-85ac55c7c80a\") " pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.549911 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549765 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:37.549911 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549805 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/91579e6e-91eb-49bc-8bee-85ac55c7c80a-host-slash\") pod \"iptables-alerter-m7lb5\" (UID: \"91579e6e-91eb-49bc-8bee-85ac55c7c80a\") " pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.549911 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.549882 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:37.550154 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.549946 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs podName:0732f1f3-9b70-4a07-b1a7-2ce3d36291e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:38.049927487 +0000 UTC m=+3.136663334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs") pod "network-metrics-daemon-rh76h" (UID: "0732f1f3-9b70-4a07-b1a7-2ce3d36291e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:37.550154 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.549988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/91579e6e-91eb-49bc-8bee-85ac55c7c80a-iptables-alerter-script\") pod \"iptables-alerter-m7lb5\" (UID: \"91579e6e-91eb-49bc-8bee-85ac55c7c80a\") " pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.550249 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.550155 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/400fbd2a-170e-4079-bd8e-b16907259376-serviceca\") pod \"node-ca-v5wqc\" (UID: \"400fbd2a-170e-4079-bd8e-b16907259376\") " pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.569139 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.569099 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5z5n\" (UniqueName: \"kubernetes.io/projected/91579e6e-91eb-49bc-8bee-85ac55c7c80a-kube-api-access-k5z5n\") pod \"iptables-alerter-m7lb5\" (UID: \"91579e6e-91eb-49bc-8bee-85ac55c7c80a\") " pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.569484 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.569463 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh7qf\" (UniqueName: \"kubernetes.io/projected/400fbd2a-170e-4079-bd8e-b16907259376-kube-api-access-rh7qf\") pod \"node-ca-v5wqc\" (UID: \"400fbd2a-170e-4079-bd8e-b16907259376\") " pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.572394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.570619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8675\" (UniqueName: \"kubernetes.io/projected/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-kube-api-access-d8675\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:37.632824 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.632788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" Jul 01 19:22:37.641555 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.641523 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:22:37.651550 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.651528 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" Jul 01 19:22:37.657406 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.657380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f6c4k" Jul 01 19:22:37.664052 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.664035 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:37.664273 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.664249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hmssg" Jul 01 19:22:37.672392 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.672359 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7dcjg" Jul 01 19:22:37.678458 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.678434 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:22:37.688480 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.688447 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m7lb5" Jul 01 19:22:37.692347 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.692328 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v5wqc" Jul 01 19:22:37.882734 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:37.882590 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7dffa21_9e3e_4c53_9a39_4bec05893e52.slice/crio-fec00e9e3da181126fc31b7871b9e2d269cf6ada5d3fe0e68154a7742fa2f4ea WatchSource:0}: Error finding container fec00e9e3da181126fc31b7871b9e2d269cf6ada5d3fe0e68154a7742fa2f4ea: Status 404 returned error can't find the container with id fec00e9e3da181126fc31b7871b9e2d269cf6ada5d3fe0e68154a7742fa2f4ea Jul 01 19:22:37.889059 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:37.889029 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313478e1_ca7a_4a90_abc1_d0a8f486a0ff.slice/crio-4f1c9a00d224a15b10fc6e1980b32149ddeead39d380ab0f81b7220ab73af78c WatchSource:0}: Error finding container 4f1c9a00d224a15b10fc6e1980b32149ddeead39d380ab0f81b7220ab73af78c: Status 404 returned error can't find the container with id 4f1c9a00d224a15b10fc6e1980b32149ddeead39d380ab0f81b7220ab73af78c Jul 01 19:22:37.889990 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:37.889962 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad5feee_db3d_494d_b5d9_676907e21fa0.slice/crio-62ca81e0aa4e572972dcd87202462c395f03fe289a344afcc4d3164cca86342d WatchSource:0}: Error finding container 62ca81e0aa4e572972dcd87202462c395f03fe289a344afcc4d3164cca86342d: Status 404 returned error can't find the container with id 62ca81e0aa4e572972dcd87202462c395f03fe289a344afcc4d3164cca86342d Jul 01 19:22:37.890673 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:37.890605 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93615ebb_d773_4a72_94fe_10aadb4187a5.slice/crio-5411dc79516ed333444d391a9151655813943488a570fa88010f15beba89e0b6 WatchSource:0}: Error finding container 5411dc79516ed333444d391a9151655813943488a570fa88010f15beba89e0b6: Status 404 returned error can't find the container with id 5411dc79516ed333444d391a9151655813943488a570fa88010f15beba89e0b6 Jul 01 19:22:37.891747 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:37.891713 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0814bbe_f4c2_4088_90d0_286a484bb30f.slice/crio-382759a831b028b3b75a3f04e1655f340138b5f3a419d0c42dbb44fa08719ead WatchSource:0}: Error finding container 382759a831b028b3b75a3f04e1655f340138b5f3a419d0c42dbb44fa08719ead: Status 404 returned error can't find the container with id 382759a831b028b3b75a3f04e1655f340138b5f3a419d0c42dbb44fa08719ead Jul 01 19:22:37.892564 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:37.892519 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400fbd2a_170e_4079_bd8e_b16907259376.slice/crio-134b9c757667e05e4e0150f34238e75af00729b83af0a4db0584eaed181e8f32 WatchSource:0}: Error finding container 134b9c757667e05e4e0150f34238e75af00729b83af0a4db0584eaed181e8f32: Status 404 returned error can't find the container with id 134b9c757667e05e4e0150f34238e75af00729b83af0a4db0584eaed181e8f32 Jul 01 19:22:37.893312 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:37.893272 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0928bd05_a7e2_4498_bdaf_a70c08b988a0.slice/crio-40f7f2d9336e3c703b9c1be70fc224d7395c16752f1ef8c226a8f1c0ae5a1bf3 WatchSource:0}: Error finding container 40f7f2d9336e3c703b9c1be70fc224d7395c16752f1ef8c226a8f1c0ae5a1bf3: Status 404 returned error can't find the container with id 40f7f2d9336e3c703b9c1be70fc224d7395c16752f1ef8c226a8f1c0ae5a1bf3 Jul 01 19:22:37.895361 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:37.895250 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e4406e_8f58_49e5_8c7f_8e57a4dd0ffd.slice/crio-6c168d99c8f07fdf0e463d424c75401e34e42e12a1f47b84af4354b89b1016ab WatchSource:0}: Error finding container 6c168d99c8f07fdf0e463d424c75401e34e42e12a1f47b84af4354b89b1016ab: Status 404 returned error can't find the container with id 6c168d99c8f07fdf0e463d424c75401e34e42e12a1f47b84af4354b89b1016ab Jul 01 19:22:37.895596 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:22:37.895580 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91579e6e_91eb_49bc_8bee_85ac55c7c80a.slice/crio-18d2afb6f969d58b10e2d6ed32f9099e1527917599cb822dc131cd8f27794b2c WatchSource:0}: Error finding container 18d2afb6f969d58b10e2d6ed32f9099e1527917599cb822dc131cd8f27794b2c: Status 404 returned error can't find the container with id 18d2afb6f969d58b10e2d6ed32f9099e1527917599cb822dc131cd8f27794b2c Jul 01 19:22:37.953469 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:37.953442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:37.953607 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.953593 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:37.953663 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:37.953644 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret podName:a9484aaf-f96b-44f2-b188-e15736f70dc9 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:38.953630598 +0000 UTC m=+4.040366437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret") pod "global-pull-secret-syncer-qvdtj" (UID: "a9484aaf-f96b-44f2-b188-e15736f70dc9") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:38.053950 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.053924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:38.054065 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.053963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:38.054140 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:38.054091 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:38.054140 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:38.054115 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:38.054140 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:38.054136 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:38.054283 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:38.054148 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8bfg5 for pod openshift-network-diagnostics/network-check-target-vw4mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:38.054283 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:38.054152 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs podName:0732f1f3-9b70-4a07-b1a7-2ce3d36291e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:39.054131313 +0000 UTC m=+4.140867168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs") pod "network-metrics-daemon-rh76h" (UID: "0732f1f3-9b70-4a07-b1a7-2ce3d36291e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:38.054283 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:38.054193 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5 podName:20ac655e-bd97-431c-86ff-5af517032e3d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:39.054177311 +0000 UTC m=+4.140913153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8bfg5" (UniqueName: "kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5") pod "network-check-target-vw4mh" (UID: "20ac655e-bd97-431c-86ff-5af517032e3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:38.396174 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.395957 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:17:37 +0000 UTC" deadline="2028-04-05 23:00:35.2961423 +0000 UTC" Jul 01 19:22:38.396174 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.396166 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15459h37m56.899979459s" Jul 01 19:22:38.416746 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.416646 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hmssg" event={"ID":"313478e1-ca7a-4a90-abc1-d0a8f486a0ff","Type":"ContainerStarted","Data":"4f1c9a00d224a15b10fc6e1980b32149ddeead39d380ab0f81b7220ab73af78c"} Jul 01 19:22:38.417902 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.417876 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m7lb5" event={"ID":"91579e6e-91eb-49bc-8bee-85ac55c7c80a","Type":"ContainerStarted","Data":"18d2afb6f969d58b10e2d6ed32f9099e1527917599cb822dc131cd8f27794b2c"} Jul 01 19:22:38.436452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.419431 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mmnqc" event={"ID":"03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd","Type":"ContainerStarted","Data":"6c168d99c8f07fdf0e463d424c75401e34e42e12a1f47b84af4354b89b1016ab"} Jul 01 19:22:38.436452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.420747 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" event={"ID":"b7dffa21-9e3e-4c53-9a39-4bec05893e52","Type":"ContainerStarted","Data":"fec00e9e3da181126fc31b7871b9e2d269cf6ada5d3fe0e68154a7742fa2f4ea"} Jul 01 19:22:38.436452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.424352 2565 generic.go:356] "Generic (PLEG): container finished" podID="84db88ff65cf2a1e02da1c0d3c21d266" containerID="2bbed41685af3e6fd69751f51cbe57186953696819aaea1773d0d87168cf41ec" exitCode=0 Jul 01 19:22:38.436452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.424965 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" event={"ID":"84db88ff65cf2a1e02da1c0d3c21d266","Type":"ContainerDied","Data":"2bbed41685af3e6fd69751f51cbe57186953696819aaea1773d0d87168cf41ec"} Jul 01 19:22:38.436452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.426485 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" event={"ID":"0928bd05-a7e2-4498-bdaf-a70c08b988a0","Type":"ContainerStarted","Data":"40f7f2d9336e3c703b9c1be70fc224d7395c16752f1ef8c226a8f1c0ae5a1bf3"} Jul 01 19:22:38.436452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.427860 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v5wqc" event={"ID":"400fbd2a-170e-4079-bd8e-b16907259376","Type":"ContainerStarted","Data":"134b9c757667e05e4e0150f34238e75af00729b83af0a4db0584eaed181e8f32"} Jul 01 19:22:38.436452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.429213 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" event={"ID":"b0814bbe-f4c2-4088-90d0-286a484bb30f","Type":"ContainerStarted","Data":"382759a831b028b3b75a3f04e1655f340138b5f3a419d0c42dbb44fa08719ead"} Jul 01 19:22:38.436452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.430797 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7dcjg" event={"ID":"93615ebb-d773-4a72-94fe-10aadb4187a5","Type":"ContainerStarted","Data":"5411dc79516ed333444d391a9151655813943488a570fa88010f15beba89e0b6"} Jul 01 19:22:38.436452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.433386 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f6c4k" event={"ID":"1ad5feee-db3d-494d-b5d9-676907e21fa0","Type":"ContainerStarted","Data":"62ca81e0aa4e572972dcd87202462c395f03fe289a344afcc4d3164cca86342d"} Jul 01 19:22:38.961836 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:38.961791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:38.962036 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:38.962013 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:38.962109 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:38.962092 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret podName:a9484aaf-f96b-44f2-b188-e15736f70dc9 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:40.962072759 +0000 UTC m=+6.048808618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret") pod "global-pull-secret-syncer-qvdtj" (UID: "a9484aaf-f96b-44f2-b188-e15736f70dc9") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:39.062673 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:39.062633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:39.062836 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:39.062689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:39.062880 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:39.062862 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:39.062936 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:39.062923 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs podName:0732f1f3-9b70-4a07-b1a7-2ce3d36291e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:41.062904602 +0000 UTC m=+6.149640448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs") pod "network-metrics-daemon-rh76h" (UID: "0732f1f3-9b70-4a07-b1a7-2ce3d36291e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:39.063035 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:39.063021 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:39.063108 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:39.063041 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:39.063108 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:39.063055 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8bfg5 for pod openshift-network-diagnostics/network-check-target-vw4mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:39.063108 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:39.063094 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5 podName:20ac655e-bd97-431c-86ff-5af517032e3d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:41.063080304 +0000 UTC m=+6.149816144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8bfg5" (UniqueName: "kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5") pod "network-check-target-vw4mh" (UID: "20ac655e-bd97-431c-86ff-5af517032e3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:39.397256 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:39.397189 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:17:37 +0000 UTC" deadline="2028-01-15 14:57:34.279271901 +0000 UTC" Jul 01 19:22:39.397256 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:39.397254 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13507h34m54.88202257s" Jul 01 19:22:39.406143 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:39.406117 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:39.406274 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:39.406246 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:39.406745 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:39.406688 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:39.406826 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:39.406800 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:39.406951 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:39.406861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:39.406951 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:39.406930 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:39.456840 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:39.456807 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" event={"ID":"84db88ff65cf2a1e02da1c0d3c21d266","Type":"ContainerStarted","Data":"49fdd24739d4ca04ff0a89e328fdcbae06b5f4daeb274e059269260da539beec"} Jul 01 19:22:39.482113 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:39.482055 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-235.ec2.internal" podStartSLOduration=2.4820354829999998 podStartE2EDuration="2.482035483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:39.480188707 +0000 UTC m=+4.566924570" watchObservedRunningTime="2026-07-01 19:22:39.482035483 +0000 UTC m=+4.568771347" Jul 01 19:22:40.979036 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:40.978996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:40.979463 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:40.979213 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:40.979463 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:40.979278 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret podName:a9484aaf-f96b-44f2-b188-e15736f70dc9 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:44.979258929 +0000 UTC m=+10.065994770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret") pod "global-pull-secret-syncer-qvdtj" (UID: "a9484aaf-f96b-44f2-b188-e15736f70dc9") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:41.079866 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:41.079827 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:41.080048 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:41.079882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:41.080113 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:41.080056 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:41.080173 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:41.080120 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs podName:0732f1f3-9b70-4a07-b1a7-2ce3d36291e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:45.080101228 +0000 UTC m=+10.166837070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs") pod "network-metrics-daemon-rh76h" (UID: "0732f1f3-9b70-4a07-b1a7-2ce3d36291e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:41.080641 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:41.080619 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:41.080744 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:41.080647 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:41.080744 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:41.080662 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8bfg5 for pod openshift-network-diagnostics/network-check-target-vw4mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:41.080744 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:41.080715 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5 podName:20ac655e-bd97-431c-86ff-5af517032e3d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:45.080697315 +0000 UTC m=+10.167433157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8bfg5" (UniqueName: "kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5") pod "network-check-target-vw4mh" (UID: "20ac655e-bd97-431c-86ff-5af517032e3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:41.405590 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:41.405558 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:41.405771 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:41.405713 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:41.406117 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:41.406094 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:41.406230 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:41.406198 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:41.406298 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:41.406248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:41.406350 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:41.406310 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:43.403871 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:43.403788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:43.404250 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:43.403907 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:43.404250 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:43.404232 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:43.404323 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:43.404308 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:43.404359 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:43.404348 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:43.404447 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:43.404412 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:45.016744 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:45.016710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:45.017218 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.016852 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:45.017218 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.016918 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret podName:a9484aaf-f96b-44f2-b188-e15736f70dc9 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:53.016897528 +0000 UTC m=+18.103633378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret") pod "global-pull-secret-syncer-qvdtj" (UID: "a9484aaf-f96b-44f2-b188-e15736f70dc9") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:45.117726 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:45.117691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:45.117881 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:45.117739 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:45.117881 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.117859 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:45.118007 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.117896 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:45.118007 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.117922 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:45.118007 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.117928 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs podName:0732f1f3-9b70-4a07-b1a7-2ce3d36291e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:53.117908785 +0000 UTC m=+18.204644643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs") pod "network-metrics-daemon-rh76h" (UID: "0732f1f3-9b70-4a07-b1a7-2ce3d36291e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:45.118007 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.117935 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8bfg5 for pod openshift-network-diagnostics/network-check-target-vw4mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:45.118007 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.117985 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5 podName:20ac655e-bd97-431c-86ff-5af517032e3d nodeName:}" failed. No retries permitted until 2026-07-01 19:22:53.117969035 +0000 UTC m=+18.204704873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8bfg5" (UniqueName: "kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5") pod "network-check-target-vw4mh" (UID: "20ac655e-bd97-431c-86ff-5af517032e3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:45.405914 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:45.404243 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:45.405914 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.404379 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:45.405914 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:45.405687 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:45.405914 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.405759 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:45.405914 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:45.405803 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:45.405914 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:45.405849 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:47.404576 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:47.404533 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:47.405066 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:47.404669 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:47.405140 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:47.405067 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:47.405200 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:47.405173 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:47.405256 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:47.405225 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:47.405309 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:47.405292 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:49.406662 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:49.406630 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:49.406662 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:49.406663 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:49.407141 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:49.406668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:49.407141 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:49.406741 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:49.407141 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:49.406789 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:49.407141 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:49.406923 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:51.406687 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:51.406662 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:51.407061 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:51.406757 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:51.407061 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:51.407059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:51.407210 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:51.407082 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:51.407210 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:51.407145 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:51.407279 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:51.407221 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:53.081555 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:53.081497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:53.082084 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.081651 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:53.082084 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.081723 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret podName:a9484aaf-f96b-44f2-b188-e15736f70dc9 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:09.081703178 +0000 UTC m=+34.168439021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret") pod "global-pull-secret-syncer-qvdtj" (UID: "a9484aaf-f96b-44f2-b188-e15736f70dc9") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:53.182780 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:53.182741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:53.182780 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:53.182785 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:53.182993 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.182884 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:53.182993 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.182936 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs podName:0732f1f3-9b70-4a07-b1a7-2ce3d36291e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:09.182918062 +0000 UTC m=+34.269653900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs") pod "network-metrics-daemon-rh76h" (UID: "0732f1f3-9b70-4a07-b1a7-2ce3d36291e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:53.183332 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.183310 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:53.183332 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.183333 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:53.183524 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.183345 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8bfg5 for pod openshift-network-diagnostics/network-check-target-vw4mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:53.183524 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.183414 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5 podName:20ac655e-bd97-431c-86ff-5af517032e3d nodeName:}" failed. No retries permitted until 2026-07-01 19:23:09.183398925 +0000 UTC m=+34.270134786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8bfg5" (UniqueName: "kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5") pod "network-check-target-vw4mh" (UID: "20ac655e-bd97-431c-86ff-5af517032e3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:53.404252 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:53.404175 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:53.404252 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:53.404218 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:53.404475 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:53.404175 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:53.404475 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.404291 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:53.404475 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.404353 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:53.404475 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:53.404452 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:55.407099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:55.407064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:55.407099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:55.407098 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:55.407629 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:55.407182 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:55.407629 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:55.407065 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:55.407629 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:55.407285 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:55.407629 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:55.407391 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:57.404575 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:57.404534 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:57.405130 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:57.404535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:57.405130 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:57.404667 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:57.405130 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:57.404538 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:57.405130 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:57.404739 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:57.405130 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:57.404833 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:58.500514 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.500310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal" event={"ID":"847db0cc99df2dba82bff072bfa78f80","Type":"ContainerStarted","Data":"879ca6daa0fb24f383dce57b33ea6413d6925ee0073b8b52bc55ea8452905947"} Jul 01 19:22:58.502465 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.502441 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" event={"ID":"0928bd05-a7e2-4498-bdaf-a70c08b988a0","Type":"ContainerStarted","Data":"409dcbd9705187bc9fd22a1719069abfca71913ef7f7c28795e4cce24655797d"} Jul 01 19:22:58.502586 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.502517 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" event={"ID":"0928bd05-a7e2-4498-bdaf-a70c08b988a0","Type":"ContainerStarted","Data":"bd6ef32ac0bf16ff58de613035e4bb9177fe0506e1ab1054af58dc2ac189400c"} Jul 01 19:22:58.502586 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.502565 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" event={"ID":"0928bd05-a7e2-4498-bdaf-a70c08b988a0","Type":"ContainerStarted","Data":"0dfafce47c5d8ef6090c6354d58d6c73b02a590d1c9135ec54cd3d24956e8d7f"} Jul 01 19:22:58.504807 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.504094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v5wqc" event={"ID":"400fbd2a-170e-4079-bd8e-b16907259376","Type":"ContainerStarted","Data":"0ced154ef1e903f1ee641e890291c248290375c1b7329d0b78d87195169c6ab7"} Jul 01 19:22:58.505633 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.505606 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" event={"ID":"b0814bbe-f4c2-4088-90d0-286a484bb30f","Type":"ContainerStarted","Data":"0af80cb12e1eba5ad4e55cfe36eefb8a2dd3d6179f2f2839bb30fc439716e539"} Jul 01 19:22:58.506922 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.506900 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7dcjg" event={"ID":"93615ebb-d773-4a72-94fe-10aadb4187a5","Type":"ContainerStarted","Data":"04ff70e3fde1cd78c8a01e402dd24e75aa4619ee0014b8aaf2b12fe29978a078"} Jul 01 19:22:58.508235 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.508209 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f6c4k" event={"ID":"1ad5feee-db3d-494d-b5d9-676907e21fa0","Type":"ContainerStarted","Data":"f3c9220609680c01c277bf434f1cf11c80641051a6c2a41b2c3d69e3d9d73fe3"} Jul 01 19:22:58.509845 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.509817 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hmssg" event={"ID":"313478e1-ca7a-4a90-abc1-d0a8f486a0ff","Type":"ContainerStarted","Data":"a2553febe65ad0f85bcc0b2ecbfcfe77d0f02b4090cbcf582afba56fdabee6a8"} Jul 01 19:22:58.513612 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.513533 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mmnqc" event={"ID":"03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd","Type":"ContainerStarted","Data":"663f401d8512b51a0491933748681e3a9efa7f88718c6a692f17e108b5b04ab4"} Jul 01 19:22:58.519152 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.519125 2565 generic.go:356] "Generic (PLEG): container finished" podID="b7dffa21-9e3e-4c53-9a39-4bec05893e52" containerID="45ba6c0591634673f402b69b42a13ec727c9fcac3d9021ca0f744b9453cd2e0d" exitCode=0 Jul 01 19:22:58.519254 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.519167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" event={"ID":"b7dffa21-9e3e-4c53-9a39-4bec05893e52","Type":"ContainerDied","Data":"45ba6c0591634673f402b69b42a13ec727c9fcac3d9021ca0f744b9453cd2e0d"} Jul 01 19:22:58.534781 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.534741 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v5wqc" podStartSLOduration=2.349907207 podStartE2EDuration="22.534728967s" totalImagesPullingTime="20.18482176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:58.534550834 +0000 UTC m=+23.621286693" watchObservedRunningTime="2026-07-01 19:22:58.534728967 +0000 UTC m=+23.621464827" Jul 01 19:22:58.556156 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.556114 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mmnqc" podStartSLOduration=2.374885637 podStartE2EDuration="22.556099396s" totalImagesPullingTime="20.181213759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:58.554764972 +0000 UTC m=+23.641500832" watchObservedRunningTime="2026-07-01 19:22:58.556099396 +0000 UTC m=+23.642835255" Jul 01 19:22:58.591700 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.591607 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hmssg" podStartSLOduration=2.402684529 podStartE2EDuration="22.591591755s" totalImagesPullingTime="20.188907226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:58.591185732 +0000 UTC m=+23.677921592" watchObservedRunningTime="2026-07-01 19:22:58.591591755 +0000 UTC m=+23.678327616" Jul 01 19:22:58.651645 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.651606 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7dcjg" podStartSLOduration=2.387439418 podStartE2EDuration="22.651590625s" totalImagesPullingTime="20.264151207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:58.632286565 +0000 UTC m=+23.719022427" watchObservedRunningTime="2026-07-01 19:22:58.651590625 +0000 UTC m=+23.738326508" Jul 01 19:22:58.684214 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:58.684176 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-235.ec2.internal" podStartSLOduration=21.684160951 podStartE2EDuration="21.684160951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:58.651665256 +0000 UTC m=+23.738401118" watchObservedRunningTime="2026-07-01 19:22:58.684160951 +0000 UTC m=+23.770896850" Jul 01 19:22:59.404560 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:59.404522 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:22:59.404791 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:59.404570 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:22:59.404791 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:59.404520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:22:59.404791 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:59.404660 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:22:59.404791 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:59.404752 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:22:59.404996 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:22:59.404851 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:22:59.524653 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:59.524621 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" event={"ID":"0928bd05-a7e2-4498-bdaf-a70c08b988a0","Type":"ContainerStarted","Data":"3d8816f225e1d62f901163712d045e516eff54c2d89a9999c292d89feefd0c4e"} Jul 01 19:22:59.525308 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:59.524693 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" event={"ID":"0928bd05-a7e2-4498-bdaf-a70c08b988a0","Type":"ContainerStarted","Data":"c65ef4dd869bc51940fe789bdbd011dbbb7943b8993fdae166e98b9c4c4139d4"} Jul 01 19:22:59.525308 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:59.524736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" event={"ID":"0928bd05-a7e2-4498-bdaf-a70c08b988a0","Type":"ContainerStarted","Data":"8f4a6cb18e7bfb2cff3bd5d7fc6e41e01306555791d1645df5cf8ae7c88ffc32"} Jul 01 19:22:59.669468 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:22:59.669144 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:23:00.419674 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:00.419558 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:22:59.669166075Z","UUID":"5837eecd-605f-47d2-9cd8-000a0f8895c7","Handler":null,"Name":"","Endpoint":""} Jul 01 19:23:00.421506 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:00.421481 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:23:00.421624 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:00.421533 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:23:00.529884 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:00.529855 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" event={"ID":"b0814bbe-f4c2-4088-90d0-286a484bb30f","Type":"ContainerStarted","Data":"f474d2892ee4587ee3cc85bd4c2d9c2ce752af2f653fc18350d4feabaef702bb"} Jul 01 19:23:00.532712 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:00.532507 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m7lb5" event={"ID":"91579e6e-91eb-49bc-8bee-85ac55c7c80a","Type":"ContainerStarted","Data":"5986da08d4ec074e1e946ec7a4148e5016fe58c0db801fb63ea53e6bd7fd1cc4"} Jul 01 19:23:00.551513 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:00.551456 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f6c4k" podStartSLOduration=4.363508573 podStartE2EDuration="24.551436852s" totalImagesPullingTime="20.187928279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:58.725725146 +0000 UTC m=+23.812461006" watchObservedRunningTime="2026-07-01 19:23:00.551436852 +0000 UTC m=+25.638172713" Jul 01 19:23:00.551928 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:00.551899 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m7lb5" podStartSLOduration=4.363573647 podStartE2EDuration="24.551891513s" totalImagesPullingTime="20.188317866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:00.550255075 +0000 UTC m=+25.636990936" watchObservedRunningTime="2026-07-01 19:23:00.551891513 +0000 UTC m=+25.638627374" Jul 01 19:23:01.404124 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:01.404049 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:01.404124 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:01.404096 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:01.404383 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:01.404182 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:23:01.404383 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:01.404262 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:23:01.404383 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:01.404334 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:23:01.404530 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:01.404440 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:23:01.538542 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:01.538505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" event={"ID":"0928bd05-a7e2-4498-bdaf-a70c08b988a0","Type":"ContainerStarted","Data":"b97f6bc0a3b71fdfaa3d40af54fba2108fb6d68aae601d1722959c200f1a45df"} Jul 01 19:23:01.540983 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:01.540955 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" event={"ID":"b0814bbe-f4c2-4088-90d0-286a484bb30f","Type":"ContainerStarted","Data":"b607c7f73ee44d33b56107c8d961094eb54bcdeb9a2f7425abde7f6101b6137f"} Jul 01 19:23:01.566005 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:01.565962 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ff2hg" podStartSLOduration=3.061550808 podStartE2EDuration="25.565947229s" totalImagesPullingTime="22.504396421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:01.565886301 +0000 UTC m=+26.652622161" watchObservedRunningTime="2026-07-01 19:23:01.565947229 +0000 UTC m=+26.652683087" Jul 01 19:23:02.076810 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:02.076775 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:23:02.077773 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:02.077751 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:23:03.404124 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.403943 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:03.404803 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.403951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:23:03.404803 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:03.404217 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:23:03.404803 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.403961 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:03.404803 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:03.404301 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:23:03.404803 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:03.404353 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:23:03.548716 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.548686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" event={"ID":"0928bd05-a7e2-4498-bdaf-a70c08b988a0","Type":"ContainerStarted","Data":"06229a1da80e0f6a9952d609a31e422cc769b8871b7332112e7496d6d65c0e31"} Jul 01 19:23:03.548944 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.548925 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:23:03.549117 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.549001 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:23:03.550503 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.550480 2565 generic.go:356] "Generic (PLEG): container finished" podID="b7dffa21-9e3e-4c53-9a39-4bec05893e52" containerID="2715fa932bce931ef0afed08e5f4f5a234b1e4be619cee8dd3c11bb376fdf61c" exitCode=0 Jul 01 19:23:03.550600 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.550514 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" event={"ID":"b7dffa21-9e3e-4c53-9a39-4bec05893e52","Type":"ContainerDied","Data":"2715fa932bce931ef0afed08e5f4f5a234b1e4be619cee8dd3c11bb376fdf61c"} Jul 01 19:23:03.565119 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.565099 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:23:03.580408 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:03.580348 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" podStartSLOduration=7.321668186 podStartE2EDuration="27.580337006s" totalImagesPullingTime="20.25866882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:03.580087567 +0000 UTC m=+28.666823429" watchObservedRunningTime="2026-07-01 19:23:03.580337006 +0000 UTC m=+28.667072898" Jul 01 19:23:04.556245 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:04.556014 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:23:04.571101 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:04.571078 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:23:05.341584 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:05.341554 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rh76h"] Jul 01 19:23:05.341824 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:05.341686 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:23:05.341824 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:05.341803 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:23:05.344170 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:05.344146 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qvdtj"] Jul 01 19:23:05.344265 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:05.344249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:05.344394 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:05.344344 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:23:05.355275 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:05.355247 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vw4mh"] Jul 01 19:23:05.355400 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:05.355343 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:05.355467 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:05.355452 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:23:05.559601 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:05.559565 2565 generic.go:356] "Generic (PLEG): container finished" podID="b7dffa21-9e3e-4c53-9a39-4bec05893e52" containerID="2d7488142ed5b1c4bde09a98ca0305453937f838a2efac39f5d3b6222c8592f2" exitCode=0 Jul 01 19:23:05.560099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:05.559647 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" event={"ID":"b7dffa21-9e3e-4c53-9a39-4bec05893e52","Type":"ContainerDied","Data":"2d7488142ed5b1c4bde09a98ca0305453937f838a2efac39f5d3b6222c8592f2"} Jul 01 19:23:06.404456 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:06.404423 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:06.404619 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:06.404527 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:23:06.876594 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:06.876576 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:23:06.876913 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:06.876692 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 19:23:06.877185 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:06.877163 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mmnqc" Jul 01 19:23:07.404090 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:07.404015 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:07.404090 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:07.404041 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:23:07.404292 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:07.404173 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:23:07.404292 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:07.404253 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:23:07.566681 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:07.566651 2565 generic.go:356] "Generic (PLEG): container finished" podID="b7dffa21-9e3e-4c53-9a39-4bec05893e52" containerID="b402b5553d1cab63643f8d528e8a87bb2a2c3fac5fdbdc6e48f4b31db3825022" exitCode=0 Jul 01 19:23:07.567170 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:07.567151 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" event={"ID":"b7dffa21-9e3e-4c53-9a39-4bec05893e52","Type":"ContainerDied","Data":"b402b5553d1cab63643f8d528e8a87bb2a2c3fac5fdbdc6e48f4b31db3825022"} Jul 01 19:23:08.404531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:08.404338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:08.404920 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:08.404614 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:23:09.097620 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:09.097589 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:09.097784 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.097767 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:09.097860 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.097847 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret podName:a9484aaf-f96b-44f2-b188-e15736f70dc9 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:41.097827773 +0000 UTC m=+66.184563611 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret") pod "global-pull-secret-syncer-qvdtj" (UID: "a9484aaf-f96b-44f2-b188-e15736f70dc9") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:09.198981 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:09.198944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:09.198981 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:09.198980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:23:09.199186 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.199106 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:09.199186 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.199167 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs podName:0732f1f3-9b70-4a07-b1a7-2ce3d36291e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:41.199148815 +0000 UTC m=+66.285884655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs") pod "network-metrics-daemon-rh76h" (UID: "0732f1f3-9b70-4a07-b1a7-2ce3d36291e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:09.199514 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.199487 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:09.199514 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.199509 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:09.199684 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.199522 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8bfg5 for pod openshift-network-diagnostics/network-check-target-vw4mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:09.199684 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.199575 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5 podName:20ac655e-bd97-431c-86ff-5af517032e3d nodeName:}" failed. No retries permitted until 2026-07-01 19:23:41.19956366 +0000 UTC m=+66.286299501 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8bfg5" (UniqueName: "kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5") pod "network-check-target-vw4mh" (UID: "20ac655e-bd97-431c-86ff-5af517032e3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:09.404116 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:09.403798 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:09.404116 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.403923 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vw4mh" podUID="20ac655e-bd97-431c-86ff-5af517032e3d" Jul 01 19:23:09.404116 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:09.403981 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:23:09.405997 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:09.404874 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh76h" podUID="0732f1f3-9b70-4a07-b1a7-2ce3d36291e3" Jul 01 19:23:10.404160 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:10.404126 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:10.404402 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:10.404238 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvdtj" podUID="a9484aaf-f96b-44f2-b188-e15736f70dc9" Jul 01 19:23:11.235599 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.235569 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-235.ec2.internal" event="NodeReady" Jul 01 19:23:11.236170 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.235706 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:23:11.289942 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.289901 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k2dw2"] Jul 01 19:23:11.314045 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.314017 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qzlkr"] Jul 01 19:23:11.314221 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.314142 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.316970 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.316948 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rdgrk\"" Jul 01 19:23:11.317261 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.317180 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:23:11.317386 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.317316 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:23:11.327999 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.327924 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzlkr"] Jul 01 19:23:11.328090 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.327999 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzlkr" Jul 01 19:23:11.328090 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.328049 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k2dw2"] Jul 01 19:23:11.330985 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.330965 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9btb6\"" Jul 01 19:23:11.331336 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.331317 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:23:11.332058 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.332038 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:23:11.332145 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.332067 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:23:11.403784 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.403759 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:11.403992 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.403962 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:23:11.406649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.406400 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:23:11.406649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.406422 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:23:11.406649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.406480 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4g2f5\"" Jul 01 19:23:11.406649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.406420 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:23:11.406649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.406560 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsxvz\"" Jul 01 19:23:11.414236 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.414217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9eff814-7447-4424-a1db-78f99451f0ad-tmp-dir\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.414336 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.414245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e279fbb-1137-427a-9e11-a880f1febe7d-cert\") pod \"ingress-canary-qzlkr\" (UID: \"1e279fbb-1137-427a-9e11-a880f1febe7d\") " pod="openshift-ingress-canary/ingress-canary-qzlkr" Jul 01 19:23:11.414336 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.414267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx9wd\" (UniqueName: \"kubernetes.io/projected/1e279fbb-1137-427a-9e11-a880f1febe7d-kube-api-access-nx9wd\") pod \"ingress-canary-qzlkr\" (UID: \"1e279fbb-1137-427a-9e11-a880f1febe7d\") " pod="openshift-ingress-canary/ingress-canary-qzlkr" Jul 01 19:23:11.414336 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.414310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqxsd\" (UniqueName: \"kubernetes.io/projected/c9eff814-7447-4424-a1db-78f99451f0ad-kube-api-access-zqxsd\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.414536 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.414337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9eff814-7447-4424-a1db-78f99451f0ad-config-volume\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.414536 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.414385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.515430 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.515403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9eff814-7447-4424-a1db-78f99451f0ad-tmp-dir\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.515600 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.515439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e279fbb-1137-427a-9e11-a880f1febe7d-cert\") pod \"ingress-canary-qzlkr\" (UID: \"1e279fbb-1137-427a-9e11-a880f1febe7d\") " pod="openshift-ingress-canary/ingress-canary-qzlkr" Jul 01 19:23:11.515600 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.515460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx9wd\" (UniqueName: \"kubernetes.io/projected/1e279fbb-1137-427a-9e11-a880f1febe7d-kube-api-access-nx9wd\") pod \"ingress-canary-qzlkr\" (UID: \"1e279fbb-1137-427a-9e11-a880f1febe7d\") " pod="openshift-ingress-canary/ingress-canary-qzlkr" Jul 01 19:23:11.515709 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.515634 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqxsd\" (UniqueName: \"kubernetes.io/projected/c9eff814-7447-4424-a1db-78f99451f0ad-kube-api-access-zqxsd\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.515709 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.515677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9eff814-7447-4424-a1db-78f99451f0ad-config-volume\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.515808 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.515720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.515808 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.515732 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9eff814-7447-4424-a1db-78f99451f0ad-tmp-dir\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.515903 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:11.515853 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:11.515974 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:11.515961 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls podName:c9eff814-7447-4424-a1db-78f99451f0ad nodeName:}" failed. No retries permitted until 2026-07-01 19:23:12.015939927 +0000 UTC m=+37.102675781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls") pod "dns-default-k2dw2" (UID: "c9eff814-7447-4424-a1db-78f99451f0ad") : secret "dns-default-metrics-tls" not found Jul 01 19:23:11.516097 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.516080 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9eff814-7447-4424-a1db-78f99451f0ad-config-volume\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.519591 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.519576 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e279fbb-1137-427a-9e11-a880f1febe7d-cert\") pod \"ingress-canary-qzlkr\" (UID: \"1e279fbb-1137-427a-9e11-a880f1febe7d\") " pod="openshift-ingress-canary/ingress-canary-qzlkr" Jul 01 19:23:11.524120 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.524100 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx9wd\" (UniqueName: \"kubernetes.io/projected/1e279fbb-1137-427a-9e11-a880f1febe7d-kube-api-access-nx9wd\") pod \"ingress-canary-qzlkr\" (UID: \"1e279fbb-1137-427a-9e11-a880f1febe7d\") " pod="openshift-ingress-canary/ingress-canary-qzlkr" Jul 01 19:23:11.524120 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.524114 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqxsd\" (UniqueName: \"kubernetes.io/projected/c9eff814-7447-4424-a1db-78f99451f0ad-kube-api-access-zqxsd\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:11.649048 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.649012 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzlkr" Jul 01 19:23:11.844046 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:11.844014 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzlkr"] Jul 01 19:23:12.020289 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:12.020154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:12.020404 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:12.020314 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:12.020404 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:12.020402 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls podName:c9eff814-7447-4424-a1db-78f99451f0ad nodeName:}" failed. No retries permitted until 2026-07-01 19:23:13.020385971 +0000 UTC m=+38.107121809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls") pod "dns-default-k2dw2" (UID: "c9eff814-7447-4424-a1db-78f99451f0ad") : secret "dns-default-metrics-tls" not found Jul 01 19:23:12.403923 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:12.403853 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:12.406435 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:12.406417 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:23:12.582317 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:12.582284 2565 generic.go:356] "Generic (PLEG): container finished" podID="b7dffa21-9e3e-4c53-9a39-4bec05893e52" containerID="92b94be73ec91cd5e2b13ed078883289943cd95c3ed5ea680f2334596fc2cd41" exitCode=0 Jul 01 19:23:12.582495 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:12.582381 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" event={"ID":"b7dffa21-9e3e-4c53-9a39-4bec05893e52","Type":"ContainerDied","Data":"92b94be73ec91cd5e2b13ed078883289943cd95c3ed5ea680f2334596fc2cd41"} Jul 01 19:23:12.583693 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:12.583667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzlkr" event={"ID":"1e279fbb-1137-427a-9e11-a880f1febe7d","Type":"ContainerStarted","Data":"fa5144bd5e7b07266c729732278f38b9bf4bb1d6dbef66288191d9483435c981"} Jul 01 19:23:13.028991 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:13.028955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:13.029164 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:13.029068 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:13.029164 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:13.029121 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls podName:c9eff814-7447-4424-a1db-78f99451f0ad nodeName:}" failed. No retries permitted until 2026-07-01 19:23:15.029107058 +0000 UTC m=+40.115842898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls") pod "dns-default-k2dw2" (UID: "c9eff814-7447-4424-a1db-78f99451f0ad") : secret "dns-default-metrics-tls" not found Jul 01 19:23:13.590114 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:13.590082 2565 generic.go:356] "Generic (PLEG): container finished" podID="b7dffa21-9e3e-4c53-9a39-4bec05893e52" containerID="d89d714bbacb7a503f88c0741b9c57b6e95d5ab14f20bc18c3df48e790af2cde" exitCode=0 Jul 01 19:23:13.590548 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:13.590122 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" event={"ID":"b7dffa21-9e3e-4c53-9a39-4bec05893e52","Type":"ContainerDied","Data":"d89d714bbacb7a503f88c0741b9c57b6e95d5ab14f20bc18c3df48e790af2cde"} Jul 01 19:23:14.595282 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:14.595060 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" event={"ID":"b7dffa21-9e3e-4c53-9a39-4bec05893e52","Type":"ContainerStarted","Data":"8e696e2f6bea6514495ea12f003d2fc33d534f22f9543e0152fce99aea58a4d9"} Jul 01 19:23:14.596531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:14.596506 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzlkr" event={"ID":"1e279fbb-1137-427a-9e11-a880f1febe7d","Type":"ContainerStarted","Data":"9c0619cc989ebb4f5bd9c9cf6e1bec553059c0dbcb9f42d56210cbb868a38099"} Jul 01 19:23:14.621591 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:14.621547 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kwlqs" podStartSLOduration=7.179868647 podStartE2EDuration="38.621531832s" totalImagesPullingTime="31.441663185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:14.618750372 +0000 UTC m=+39.705486233" watchObservedRunningTime="2026-07-01 19:23:14.621531832 +0000 UTC m=+39.708267695" Jul 01 19:23:14.635166 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:14.635128 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qzlkr" podStartSLOduration=1.266478082 podStartE2EDuration="3.63511943s" totalImagesPullingTime="2.368641348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:14.634493294 +0000 UTC m=+39.721229154" watchObservedRunningTime="2026-07-01 19:23:14.63511943 +0000 UTC m=+39.721855290" Jul 01 19:23:15.043696 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:15.043658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:15.043856 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:15.043774 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:15.043856 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:15.043850 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls podName:c9eff814-7447-4424-a1db-78f99451f0ad nodeName:}" failed. No retries permitted until 2026-07-01 19:23:19.04383441 +0000 UTC m=+44.130570250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls") pod "dns-default-k2dw2" (UID: "c9eff814-7447-4424-a1db-78f99451f0ad") : secret "dns-default-metrics-tls" not found Jul 01 19:23:19.069348 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:19.069313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:19.069732 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:19.069481 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:19.069732 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:19.069549 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls podName:c9eff814-7447-4424-a1db-78f99451f0ad nodeName:}" failed. No retries permitted until 2026-07-01 19:23:27.069533755 +0000 UTC m=+52.156269593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls") pod "dns-default-k2dw2" (UID: "c9eff814-7447-4424-a1db-78f99451f0ad") : secret "dns-default-metrics-tls" not found Jul 01 19:23:27.126408 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:27.126350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:27.126920 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:27.126479 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:27.126920 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:27.126532 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls podName:c9eff814-7447-4424-a1db-78f99451f0ad nodeName:}" failed. No retries permitted until 2026-07-01 19:23:43.12651813 +0000 UTC m=+68.213253968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls") pod "dns-default-k2dw2" (UID: "c9eff814-7447-4424-a1db-78f99451f0ad") : secret "dns-default-metrics-tls" not found Jul 01 19:23:36.573346 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:36.573318 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpjdc" Jul 01 19:23:38.145485 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.145451 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95"] Jul 01 19:23:38.149441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.149416 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95" Jul 01 19:23:38.150098 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.150075 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk"] Jul 01 19:23:38.151884 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.151867 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt"] Jul 01 19:23:38.151998 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.151983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:38.152821 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.152797 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 19:23:38.152909 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.152839 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:38.152909 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.152897 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qkdbz\"" Jul 01 19:23:38.153873 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.153857 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.154550 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.154534 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 19:23:38.154850 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.154835 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z77t2\"" Jul 01 19:23:38.155055 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.155038 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:38.155147 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.155119 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 19:23:38.158137 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.158120 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:23:38.158137 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.158131 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 19:23:38.158313 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.158138 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:23:38.158313 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.158141 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6j59j\"" Jul 01 19:23:38.158313 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.158179 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 19:23:38.161974 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.161951 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95"] Jul 01 19:23:38.167775 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.167754 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt"] Jul 01 19:23:38.168731 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.168710 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk"] Jul 01 19:23:38.208644 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.208613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:38.208822 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.208661 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.208822 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.208712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/363376e8-8b45-4ae0-8fd8-4150d1915f4c-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.208822 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.208747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzv6h\" (UniqueName: \"kubernetes.io/projected/0d31c4fd-225d-4cf5-aa24-a733be5095fc-kube-api-access-kzv6h\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:38.208822 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.208767 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mvhd\" (UniqueName: \"kubernetes.io/projected/c5b9d090-5e5f-407b-b99d-a481f81e8996-kube-api-access-4mvhd\") pod \"volume-data-source-validator-69d9f679db-qnt95\" (UID: \"c5b9d090-5e5f-407b-b99d-a481f81e8996\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95" Jul 01 19:23:38.208822 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.208800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qszp\" (UniqueName: \"kubernetes.io/projected/363376e8-8b45-4ae0-8fd8-4150d1915f4c-kube-api-access-4qszp\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.254778 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.254732 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-whnqd"] Jul 01 19:23:38.258133 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.258109 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.264124 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.263966 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:23:38.264124 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.263980 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 19:23:38.264320 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.264299 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jsmvc\"" Jul 01 19:23:38.265104 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.265081 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 19:23:38.265434 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.265417 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:23:38.286429 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.286408 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-whnqd"] Jul 01 19:23:38.293934 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.293913 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 19:23:38.309656 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzv6h\" (UniqueName: \"kubernetes.io/projected/0d31c4fd-225d-4cf5-aa24-a733be5095fc-kube-api-access-kzv6h\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:38.309748 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mvhd\" (UniqueName: \"kubernetes.io/projected/c5b9d090-5e5f-407b-b99d-a481f81e8996-kube-api-access-4mvhd\") pod \"volume-data-source-validator-69d9f679db-qnt95\" (UID: \"c5b9d090-5e5f-407b-b99d-a481f81e8996\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95" Jul 01 19:23:38.309748 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d16cf183-6132-401c-b4d0-de32c5efd8a6-tmp\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.309748 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qszp\" (UniqueName: \"kubernetes.io/projected/363376e8-8b45-4ae0-8fd8-4150d1915f4c-kube-api-access-4qszp\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.309748 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d16cf183-6132-401c-b4d0-de32c5efd8a6-serving-cert\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.309748 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5s4m\" (UniqueName: \"kubernetes.io/projected/d16cf183-6132-401c-b4d0-de32c5efd8a6-kube-api-access-g5s4m\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.309919 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16cf183-6132-401c-b4d0-de32c5efd8a6-service-ca-bundle\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.309919 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d16cf183-6132-401c-b4d0-de32c5efd8a6-snapshots\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.309919 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309916 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16cf183-6132-401c-b4d0-de32c5efd8a6-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.310014 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:38.310014 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.310014 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.309996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/363376e8-8b45-4ae0-8fd8-4150d1915f4c-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.310118 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:38.310049 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:23:38.310118 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:38.310094 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:38.310192 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:38.310129 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls podName:0d31c4fd-225d-4cf5-aa24-a733be5095fc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:38.810109068 +0000 UTC m=+63.896844909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-skmfk" (UID: "0d31c4fd-225d-4cf5-aa24-a733be5095fc") : secret "samples-operator-tls" not found Jul 01 19:23:38.310192 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:38.310148 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls podName:363376e8-8b45-4ae0-8fd8-4150d1915f4c nodeName:}" failed. No retries permitted until 2026-07-01 19:23:38.810136347 +0000 UTC m=+63.896872186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vsvjt" (UID: "363376e8-8b45-4ae0-8fd8-4150d1915f4c") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:38.310590 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.310575 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/363376e8-8b45-4ae0-8fd8-4150d1915f4c-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.329649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.329621 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzv6h\" (UniqueName: \"kubernetes.io/projected/0d31c4fd-225d-4cf5-aa24-a733be5095fc-kube-api-access-kzv6h\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:38.333875 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.333853 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qszp\" (UniqueName: \"kubernetes.io/projected/363376e8-8b45-4ae0-8fd8-4150d1915f4c-kube-api-access-4qszp\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.334188 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.334165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mvhd\" (UniqueName: \"kubernetes.io/projected/c5b9d090-5e5f-407b-b99d-a481f81e8996-kube-api-access-4mvhd\") pod \"volume-data-source-validator-69d9f679db-qnt95\" (UID: \"c5b9d090-5e5f-407b-b99d-a481f81e8996\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95" Jul 01 19:23:38.410905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.410801 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16cf183-6132-401c-b4d0-de32c5efd8a6-service-ca-bundle\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.410905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.410856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d16cf183-6132-401c-b4d0-de32c5efd8a6-snapshots\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.411086 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.411002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16cf183-6132-401c-b4d0-de32c5efd8a6-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.411131 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.411112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d16cf183-6132-401c-b4d0-de32c5efd8a6-tmp\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.411169 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.411156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d16cf183-6132-401c-b4d0-de32c5efd8a6-serving-cert\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.411200 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.411183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5s4m\" (UniqueName: \"kubernetes.io/projected/d16cf183-6132-401c-b4d0-de32c5efd8a6-kube-api-access-g5s4m\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.411465 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.411444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16cf183-6132-401c-b4d0-de32c5efd8a6-service-ca-bundle\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.411510 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.411465 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d16cf183-6132-401c-b4d0-de32c5efd8a6-snapshots\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.411510 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.411467 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d16cf183-6132-401c-b4d0-de32c5efd8a6-tmp\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.411845 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.411826 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16cf183-6132-401c-b4d0-de32c5efd8a6-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.413518 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.413488 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d16cf183-6132-401c-b4d0-de32c5efd8a6-serving-cert\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.419315 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.419292 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5s4m\" (UniqueName: \"kubernetes.io/projected/d16cf183-6132-401c-b4d0-de32c5efd8a6-kube-api-access-g5s4m\") pod \"insights-operator-5f67b55555-whnqd\" (UID: \"d16cf183-6132-401c-b4d0-de32c5efd8a6\") " pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.459427 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.459390 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95" Jul 01 19:23:38.566716 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.566688 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-whnqd" Jul 01 19:23:38.583155 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.583131 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95"] Jul 01 19:23:38.585770 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:23:38.585744 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b9d090_5e5f_407b_b99d_a481f81e8996.slice/crio-da08dc97fde05d70ea48dfc641aeeb9c39988d08806e7c038d94cdb090e80288 WatchSource:0}: Error finding container da08dc97fde05d70ea48dfc641aeeb9c39988d08806e7c038d94cdb090e80288: Status 404 returned error can't find the container with id da08dc97fde05d70ea48dfc641aeeb9c39988d08806e7c038d94cdb090e80288 Jul 01 19:23:38.650902 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.650860 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95" event={"ID":"c5b9d090-5e5f-407b-b99d-a481f81e8996","Type":"ContainerStarted","Data":"da08dc97fde05d70ea48dfc641aeeb9c39988d08806e7c038d94cdb090e80288"} Jul 01 19:23:38.690743 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.690658 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-whnqd"] Jul 01 19:23:38.694258 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:23:38.694232 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16cf183_6132_401c_b4d0_de32c5efd8a6.slice/crio-f669da0ed5a50382f96b72b4e16373551d2512df2782c8afaf4cefc5ee761404 WatchSource:0}: Error finding container f669da0ed5a50382f96b72b4e16373551d2512df2782c8afaf4cefc5ee761404: Status 404 returned error can't find the container with id f669da0ed5a50382f96b72b4e16373551d2512df2782c8afaf4cefc5ee761404 Jul 01 19:23:38.816277 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.816221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:38.816491 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:38.816306 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:38.816491 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:38.816395 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:23:38.816491 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:38.816437 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:38.816491 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:38.816462 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls podName:0d31c4fd-225d-4cf5-aa24-a733be5095fc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:39.81644701 +0000 UTC m=+64.903182849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-skmfk" (UID: "0d31c4fd-225d-4cf5-aa24-a733be5095fc") : secret "samples-operator-tls" not found Jul 01 19:23:38.816491 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:38.816490 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls podName:363376e8-8b45-4ae0-8fd8-4150d1915f4c nodeName:}" failed. No retries permitted until 2026-07-01 19:23:39.816475632 +0000 UTC m=+64.903211473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vsvjt" (UID: "363376e8-8b45-4ae0-8fd8-4150d1915f4c") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:39.654581 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:39.654538 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-whnqd" event={"ID":"d16cf183-6132-401c-b4d0-de32c5efd8a6","Type":"ContainerStarted","Data":"f669da0ed5a50382f96b72b4e16373551d2512df2782c8afaf4cefc5ee761404"} Jul 01 19:23:39.824229 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:39.824192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:39.824401 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:39.824246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:39.824401 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:39.824345 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:23:39.824401 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:39.824378 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:39.824506 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:39.824426 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls podName:0d31c4fd-225d-4cf5-aa24-a733be5095fc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:41.824412897 +0000 UTC m=+66.911148735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-skmfk" (UID: "0d31c4fd-225d-4cf5-aa24-a733be5095fc") : secret "samples-operator-tls" not found Jul 01 19:23:39.824506 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:39.824441 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls podName:363376e8-8b45-4ae0-8fd8-4150d1915f4c nodeName:}" failed. No retries permitted until 2026-07-01 19:23:41.824434477 +0000 UTC m=+66.911170314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vsvjt" (UID: "363376e8-8b45-4ae0-8fd8-4150d1915f4c") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:41.134654 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.134583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:41.137284 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.137268 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:23:41.147777 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.147755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9484aaf-f96b-44f2-b188-e15736f70dc9-original-pull-secret\") pod \"global-pull-secret-syncer-qvdtj\" (UID: \"a9484aaf-f96b-44f2-b188-e15736f70dc9\") " pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:41.212161 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.212123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvdtj" Jul 01 19:23:41.235408 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.235378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:41.235525 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.235423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:23:41.238604 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.238584 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:23:41.238708 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.238655 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:23:41.245773 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.245753 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 19:23:41.245843 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.245822 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs podName:0732f1f3-9b70-4a07-b1a7-2ce3d36291e3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:45.24580195 +0000 UTC m=+130.332537803 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs") pod "network-metrics-daemon-rh76h" (UID: "0732f1f3-9b70-4a07-b1a7-2ce3d36291e3") : secret "metrics-daemon-secret" not found Jul 01 19:23:41.248213 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.248196 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:23:41.259475 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.259452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bfg5\" (UniqueName: \"kubernetes.io/projected/20ac655e-bd97-431c-86ff-5af517032e3d-kube-api-access-8bfg5\") pod \"network-check-target-vw4mh\" (UID: \"20ac655e-bd97-431c-86ff-5af517032e3d\") " pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:41.336981 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.336955 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qvdtj"] Jul 01 19:23:41.339804 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:23:41.339782 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9484aaf_f96b_44f2_b188_e15736f70dc9.slice/crio-bde5b4e93ce90fe7250d4f9afd5ec32d2d8a56f1d7d6b91fe03aecb2f33ccd34 WatchSource:0}: Error finding container bde5b4e93ce90fe7250d4f9afd5ec32d2d8a56f1d7d6b91fe03aecb2f33ccd34: Status 404 returned error can't find the container with id bde5b4e93ce90fe7250d4f9afd5ec32d2d8a56f1d7d6b91fe03aecb2f33ccd34 Jul 01 19:23:41.420245 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.417261 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4g2f5\"" Jul 01 19:23:41.424435 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.424415 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:41.553784 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.553755 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pqkbd"] Jul 01 19:23:41.556718 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.556701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.559411 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.559387 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:23:41.559501 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.559433 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xh89l\"" Jul 01 19:23:41.559501 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.559487 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:23:41.568497 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.568475 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vw4mh"] Jul 01 19:23:41.570872 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.570852 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pqkbd"] Jul 01 19:23:41.571647 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:23:41.571625 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ac655e_bd97_431c_86ff_5af517032e3d.slice/crio-694e4762f9910599619742a52c74d95912963797e3683124eaa56619d703e130 WatchSource:0}: Error finding container 694e4762f9910599619742a52c74d95912963797e3683124eaa56619d703e130: Status 404 returned error can't find the container with id 694e4762f9910599619742a52c74d95912963797e3683124eaa56619d703e130 Jul 01 19:23:41.638999 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.638969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44b2486a-f99b-464d-bd3e-4324394f88cc-crio-socket\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.639120 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.639026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44b2486a-f99b-464d-bd3e-4324394f88cc-data-volume\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.639120 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.639079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.639120 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.639094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.639120 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.639112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp29m\" (UniqueName: \"kubernetes.io/projected/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-api-access-qp29m\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.660797 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.660766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vw4mh" event={"ID":"20ac655e-bd97-431c-86ff-5af517032e3d","Type":"ContainerStarted","Data":"694e4762f9910599619742a52c74d95912963797e3683124eaa56619d703e130"} Jul 01 19:23:41.662191 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.662166 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-whnqd" event={"ID":"d16cf183-6132-401c-b4d0-de32c5efd8a6","Type":"ContainerStarted","Data":"4892bb1e0cb3611201610c0eb8d04e048a64217b774cec85ead53a89c4d746db"} Jul 01 19:23:41.663467 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.663448 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95" event={"ID":"c5b9d090-5e5f-407b-b99d-a481f81e8996","Type":"ContainerStarted","Data":"b8cdd668aa3903010ef62ddbba1322fbc1bbaad05479db4debf30a6d96c85f3b"} Jul 01 19:23:41.664506 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.664489 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qvdtj" event={"ID":"a9484aaf-f96b-44f2-b188-e15736f70dc9","Type":"ContainerStarted","Data":"bde5b4e93ce90fe7250d4f9afd5ec32d2d8a56f1d7d6b91fe03aecb2f33ccd34"} Jul 01 19:23:41.683636 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.683551 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-whnqd" podStartSLOduration=1.56297892 podStartE2EDuration="3.683537468s" totalImagesPullingTime="2.120558548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:41.681860212 +0000 UTC m=+66.768596072" watchObservedRunningTime="2026-07-01 19:23:41.683537468 +0000 UTC m=+66.770273306" Jul 01 19:23:41.697780 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.697723 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-qnt95" podStartSLOduration=1.472924733 podStartE2EDuration="3.697703452s" totalImagesPullingTime="2.224778719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:41.697343408 +0000 UTC m=+66.784079269" watchObservedRunningTime="2026-07-01 19:23:41.697703452 +0000 UTC m=+66.784439314" Jul 01 19:23:41.739890 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.739866 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44b2486a-f99b-464d-bd3e-4324394f88cc-crio-socket\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.740019 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.739916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44b2486a-f99b-464d-bd3e-4324394f88cc-data-volume\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.740019 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.739989 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44b2486a-f99b-464d-bd3e-4324394f88cc-crio-socket\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.740115 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.740074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.740115 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.740100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.740197 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.740122 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp29m\" (UniqueName: \"kubernetes.io/projected/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-api-access-qp29m\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.740258 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.740240 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:41.740312 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.740256 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44b2486a-f99b-464d-bd3e-4324394f88cc-data-volume\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.740378 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.740321 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:41.740378 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.740336 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:42.240314448 +0000 UTC m=+67.327050285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:41.740495 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.740392 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:42.240355588 +0000 UTC m=+67.327091445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : configmap "kube-rbac-proxy" not found Jul 01 19:23:41.755230 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.755209 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp29m\" (UniqueName: \"kubernetes.io/projected/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-api-access-qp29m\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:41.841131 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.841103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:41.841265 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:41.841151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:41.841265 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.841257 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:41.841342 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.841268 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:23:41.841342 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.841329 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls podName:363376e8-8b45-4ae0-8fd8-4150d1915f4c nodeName:}" failed. No retries permitted until 2026-07-01 19:23:45.841309318 +0000 UTC m=+70.928045157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vsvjt" (UID: "363376e8-8b45-4ae0-8fd8-4150d1915f4c") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:41.841469 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:41.841404 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls podName:0d31c4fd-225d-4cf5-aa24-a733be5095fc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:45.84138015 +0000 UTC m=+70.928116002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-skmfk" (UID: "0d31c4fd-225d-4cf5-aa24-a733be5095fc") : secret "samples-operator-tls" not found Jul 01 19:23:42.244471 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.244424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:42.244916 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.244477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:42.244916 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:42.244568 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:42.244916 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:42.244632 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:42.244916 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:42.244659 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:43.24463515 +0000 UTC m=+68.331371005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : configmap "kube-rbac-proxy" not found Jul 01 19:23:42.244916 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:42.244685 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:43.244669057 +0000 UTC m=+68.331404897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:42.464761 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.464728 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-mdcrp"] Jul 01 19:23:42.467165 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.467141 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-mdcrp" Jul 01 19:23:42.469660 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.469636 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zbrs2\"" Jul 01 19:23:42.478041 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.478016 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-mdcrp"] Jul 01 19:23:42.548161 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.547993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5xv7\" (UniqueName: \"kubernetes.io/projected/38fe9315-d4b0-4ddc-ad7c-0a704080a97d-kube-api-access-b5xv7\") pod \"network-check-source-56499946bc-mdcrp\" (UID: \"38fe9315-d4b0-4ddc-ad7c-0a704080a97d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-mdcrp" Jul 01 19:23:42.649452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.649415 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5xv7\" (UniqueName: \"kubernetes.io/projected/38fe9315-d4b0-4ddc-ad7c-0a704080a97d-kube-api-access-b5xv7\") pod \"network-check-source-56499946bc-mdcrp\" (UID: \"38fe9315-d4b0-4ddc-ad7c-0a704080a97d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-mdcrp" Jul 01 19:23:42.663085 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.663053 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5xv7\" (UniqueName: \"kubernetes.io/projected/38fe9315-d4b0-4ddc-ad7c-0a704080a97d-kube-api-access-b5xv7\") pod \"network-check-source-56499946bc-mdcrp\" (UID: \"38fe9315-d4b0-4ddc-ad7c-0a704080a97d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-mdcrp" Jul 01 19:23:42.778551 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.778521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-mdcrp" Jul 01 19:23:42.931688 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:42.931611 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-mdcrp"] Jul 01 19:23:42.938826 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:23:42.936477 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38fe9315_d4b0_4ddc_ad7c_0a704080a97d.slice/crio-4d2caa1aab15bb6e4546cc884544e85c32acb07505403258f7dd5a0ae32b2258 WatchSource:0}: Error finding container 4d2caa1aab15bb6e4546cc884544e85c32acb07505403258f7dd5a0ae32b2258: Status 404 returned error can't find the container with id 4d2caa1aab15bb6e4546cc884544e85c32acb07505403258f7dd5a0ae32b2258 Jul 01 19:23:43.153877 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:43.153786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:23:43.154042 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:43.153902 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:43.154042 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:43.153967 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls podName:c9eff814-7447-4424-a1db-78f99451f0ad nodeName:}" failed. No retries permitted until 2026-07-01 19:24:15.153949247 +0000 UTC m=+100.240685099 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls") pod "dns-default-k2dw2" (UID: "c9eff814-7447-4424-a1db-78f99451f0ad") : secret "dns-default-metrics-tls" not found Jul 01 19:23:43.254219 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:43.254186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:43.254219 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:43.254226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:43.254780 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:43.254416 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:43.254780 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:43.254484 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:45.254465882 +0000 UTC m=+70.341201739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:43.254885 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:43.254862 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:43.254940 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:43.254919 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:45.254903067 +0000 UTC m=+70.341638925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : configmap "kube-rbac-proxy" not found Jul 01 19:23:43.525816 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:43.525725 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f6c4k_1ad5feee-db3d-494d-b5d9-676907e21fa0/dns-node-resolver/0.log" Jul 01 19:23:43.671408 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:43.671347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-mdcrp" event={"ID":"38fe9315-d4b0-4ddc-ad7c-0a704080a97d","Type":"ContainerStarted","Data":"4d2caa1aab15bb6e4546cc884544e85c32acb07505403258f7dd5a0ae32b2258"} Jul 01 19:23:44.525180 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:44.525151 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v5wqc_400fbd2a-170e-4079-bd8e-b16907259376/node-ca/0.log" Jul 01 19:23:45.274239 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:45.274191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:45.274239 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:45.274232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:45.274497 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:45.274317 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:45.274497 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:45.274407 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:49.274388297 +0000 UTC m=+74.361124230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : configmap "kube-rbac-proxy" not found Jul 01 19:23:45.274497 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:45.274456 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:45.274652 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:45.274521 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:49.274505898 +0000 UTC m=+74.361241747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:45.328957 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:45.328927 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qzlkr_1e279fbb-1137-427a-9e11-a880f1febe7d/serve-healthcheck-canary/0.log" Jul 01 19:23:45.880680 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:45.880645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:45.881116 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:45.880701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:45.881116 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:45.880817 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 19:23:45.881116 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:45.880830 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:45.881116 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:45.880899 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls podName:363376e8-8b45-4ae0-8fd8-4150d1915f4c nodeName:}" failed. No retries permitted until 2026-07-01 19:23:53.880880235 +0000 UTC m=+78.967616076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vsvjt" (UID: "363376e8-8b45-4ae0-8fd8-4150d1915f4c") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:45.881116 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:45.880920 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls podName:0d31c4fd-225d-4cf5-aa24-a733be5095fc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:53.880910307 +0000 UTC m=+78.967646146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-skmfk" (UID: "0d31c4fd-225d-4cf5-aa24-a733be5095fc") : secret "samples-operator-tls" not found Jul 01 19:23:47.686965 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.686931 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vw4mh" event={"ID":"20ac655e-bd97-431c-86ff-5af517032e3d","Type":"ContainerStarted","Data":"cde08e5502093f319520c60a41bbebb4163274be994ffbcd70505852c48dcf34"} Jul 01 19:23:47.687452 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.686994 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:23:47.688308 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.688282 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qvdtj" event={"ID":"a9484aaf-f96b-44f2-b188-e15736f70dc9","Type":"ContainerStarted","Data":"b1f983cd2ab8f06d8a8f02d29a425b08a1157cf7331d6378c5ace8830c5ce01c"} Jul 01 19:23:47.689653 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.689630 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-mdcrp" event={"ID":"38fe9315-d4b0-4ddc-ad7c-0a704080a97d","Type":"ContainerStarted","Data":"38a18a3a4fc119d1458e9405bb9c160e54cbc67573395ba79c20b4808e55d10c"} Jul 01 19:23:47.717736 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.717693 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vw4mh" podStartSLOduration=66.555532893 podStartE2EDuration="1m11.717679187s" totalImagesPullingTime="5.162146294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:47.716053932 +0000 UTC m=+72.802789792" watchObservedRunningTime="2026-07-01 19:23:47.717679187 +0000 UTC m=+72.804415043" Jul 01 19:23:47.753729 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.753671 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qvdtj" podStartSLOduration=66.359309281 podStartE2EDuration="1m11.75365026s" totalImagesPullingTime="5.394340979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:47.752655678 +0000 UTC m=+72.839391538" watchObservedRunningTime="2026-07-01 19:23:47.75365026 +0000 UTC m=+72.840386121" Jul 01 19:23:47.841562 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.841498 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-mdcrp" podStartSLOduration=2.03463246 podStartE2EDuration="5.841478188s" totalImagesPullingTime="3.806845728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:47.792075864 +0000 UTC m=+72.878811725" watchObservedRunningTime="2026-07-01 19:23:47.841478188 +0000 UTC m=+72.928214048" Jul 01 19:23:47.841713 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.841677 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8"] Jul 01 19:23:47.864432 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.864404 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8"] Jul 01 19:23:47.864592 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.864567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:47.868917 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.868898 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 19:23:47.869048 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.868945 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 19:23:47.869122 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.869103 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jx6xg\"" Jul 01 19:23:47.869225 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.869209 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 19:23:47.869265 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.869242 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 19:23:47.896953 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.896920 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/674c1279-26cb-49a8-b025-d316f5344ade-signing-key\") pod \"service-ca-7bb4f4bcc7-rvrt8\" (UID: \"674c1279-26cb-49a8-b025-d316f5344ade\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:47.897100 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.896986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/674c1279-26cb-49a8-b025-d316f5344ade-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-rvrt8\" (UID: \"674c1279-26cb-49a8-b025-d316f5344ade\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:47.897100 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.897073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwt9t\" (UniqueName: \"kubernetes.io/projected/674c1279-26cb-49a8-b025-d316f5344ade-kube-api-access-nwt9t\") pod \"service-ca-7bb4f4bcc7-rvrt8\" (UID: \"674c1279-26cb-49a8-b025-d316f5344ade\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:47.998414 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.998386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/674c1279-26cb-49a8-b025-d316f5344ade-signing-key\") pod \"service-ca-7bb4f4bcc7-rvrt8\" (UID: \"674c1279-26cb-49a8-b025-d316f5344ade\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:47.998566 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.998449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/674c1279-26cb-49a8-b025-d316f5344ade-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-rvrt8\" (UID: \"674c1279-26cb-49a8-b025-d316f5344ade\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:47.998566 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.998488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwt9t\" (UniqueName: \"kubernetes.io/projected/674c1279-26cb-49a8-b025-d316f5344ade-kube-api-access-nwt9t\") pod \"service-ca-7bb4f4bcc7-rvrt8\" (UID: \"674c1279-26cb-49a8-b025-d316f5344ade\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:47.999208 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:47.999113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/674c1279-26cb-49a8-b025-d316f5344ade-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-rvrt8\" (UID: \"674c1279-26cb-49a8-b025-d316f5344ade\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:48.000877 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:48.000854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/674c1279-26cb-49a8-b025-d316f5344ade-signing-key\") pod \"service-ca-7bb4f4bcc7-rvrt8\" (UID: \"674c1279-26cb-49a8-b025-d316f5344ade\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:48.007911 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:48.007891 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwt9t\" (UniqueName: \"kubernetes.io/projected/674c1279-26cb-49a8-b025-d316f5344ade-kube-api-access-nwt9t\") pod \"service-ca-7bb4f4bcc7-rvrt8\" (UID: \"674c1279-26cb-49a8-b025-d316f5344ade\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:48.173783 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:48.173732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" Jul 01 19:23:48.300710 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:48.300681 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8"] Jul 01 19:23:48.303721 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:23:48.303695 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674c1279_26cb_49a8_b025_d316f5344ade.slice/crio-53e564ba11a315723b1f88a44580654d966583bece442c6bc7b622f9d97f1aa4 WatchSource:0}: Error finding container 53e564ba11a315723b1f88a44580654d966583bece442c6bc7b622f9d97f1aa4: Status 404 returned error can't find the container with id 53e564ba11a315723b1f88a44580654d966583bece442c6bc7b622f9d97f1aa4 Jul 01 19:23:48.693930 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:48.693840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" event={"ID":"674c1279-26cb-49a8-b025-d316f5344ade","Type":"ContainerStarted","Data":"53e564ba11a315723b1f88a44580654d966583bece442c6bc7b622f9d97f1aa4"} Jul 01 19:23:49.310799 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:49.310766 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:49.310984 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:49.310852 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:49.310984 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:49.310903 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:49.310984 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:49.310983 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:57.310962821 +0000 UTC m=+82.397698665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : configmap "kube-rbac-proxy" not found Jul 01 19:23:49.311154 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:49.311003 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:49.311154 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:49.311061 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:23:57.311043461 +0000 UTC m=+82.397779301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:50.701207 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:50.701132 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" event={"ID":"674c1279-26cb-49a8-b025-d316f5344ade","Type":"ContainerStarted","Data":"a31337c16d1faa30a8cfcf720b44c0a1c76247c632f505f3c5eeba3fc735b4b8"} Jul 01 19:23:53.950959 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:53.950920 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:53.950959 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:53.950960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:23:53.951496 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:53.951132 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:53.951496 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:53.951200 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls podName:363376e8-8b45-4ae0-8fd8-4150d1915f4c nodeName:}" failed. No retries permitted until 2026-07-01 19:24:09.951184935 +0000 UTC m=+95.037920774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vsvjt" (UID: "363376e8-8b45-4ae0-8fd8-4150d1915f4c") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:53.953504 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:53.953478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d31c4fd-225d-4cf5-aa24-a733be5095fc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-skmfk\" (UID: \"0d31c4fd-225d-4cf5-aa24-a733be5095fc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:54.066049 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:54.066025 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" Jul 01 19:23:54.202926 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:54.202832 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rvrt8" podStartSLOduration=5.123924884 podStartE2EDuration="7.202808539s" totalImagesPullingTime="2.078883655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:50.720542709 +0000 UTC m=+75.807278573" watchObservedRunningTime="2026-07-01 19:23:54.202808539 +0000 UTC m=+79.289544401" Jul 01 19:23:54.203099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:54.203072 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk"] Jul 01 19:23:54.715394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:54.715336 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" event={"ID":"0d31c4fd-225d-4cf5-aa24-a733be5095fc","Type":"ContainerStarted","Data":"05cbc5a7e3350fcdaf4ac6ea38aa1e0777fbcda1779a5411bea69faf8eb3f90a"} Jul 01 19:23:56.723474 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:56.723441 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" event={"ID":"0d31c4fd-225d-4cf5-aa24-a733be5095fc","Type":"ContainerStarted","Data":"09507e710fc4ba3c81b070a59a286a65f8e6cdcc7d50401d51579d706024536d"} Jul 01 19:23:56.723905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:56.723488 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" event={"ID":"0d31c4fd-225d-4cf5-aa24-a733be5095fc","Type":"ContainerStarted","Data":"fcd71f1a7d0d3b8d0701a115caad7846b4a635c29ba2cb589b19633d4f935665"} Jul 01 19:23:56.757533 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:56.757479 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-skmfk" podStartSLOduration=17.011767053 podStartE2EDuration="18.757460556s" totalImagesPullingTime="1.745693503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:56.757419002 +0000 UTC m=+81.844154864" watchObservedRunningTime="2026-07-01 19:23:56.757460556 +0000 UTC m=+81.844196418" Jul 01 19:23:57.378989 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:57.378952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:57.379164 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:57.379048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:23:57.379206 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:57.379169 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:57.379243 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:23:57.379232 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls podName:44b2486a-f99b-464d-bd3e-4324394f88cc nodeName:}" failed. No retries permitted until 2026-07-01 19:24:13.379214289 +0000 UTC m=+98.465950133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pqkbd" (UID: "44b2486a-f99b-464d-bd3e-4324394f88cc") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:57.379526 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:23:57.379508 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b2486a-f99b-464d-bd3e-4324394f88cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:24:07.436157 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.436129 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67dd756b7d-ddtpf"] Jul 01 19:24:07.438934 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.438916 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.441772 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.441743 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 19:24:07.441879 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.441860 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 19:24:07.441932 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.441893 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ftr2p\"" Jul 01 19:24:07.442833 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.442817 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 19:24:07.447547 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.447524 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 19:24:07.457334 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.457315 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67dd756b7d-ddtpf"] Jul 01 19:24:07.512209 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.512187 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67dd756b7d-ddtpf"] Jul 01 19:24:07.512394 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:24:07.512345 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-wkfwb registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" podUID="a5a13814-6b82-430a-90e4-dfaa6899175b" Jul 01 19:24:07.553469 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.553441 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57f4846bd6-w4sxh"] Jul 01 19:24:07.555952 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.555934 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.558077 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.558059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5a13814-6b82-430a-90e4-dfaa6899175b-ca-trust-extracted\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.558162 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.558099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-tls\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.558162 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.558122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-trusted-ca\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.558239 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.558200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-certificates\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.558272 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.558246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-bound-sa-token\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.558304 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.558286 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-image-registry-private-configuration\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.558336 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.558312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkfwb\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-kube-api-access-wkfwb\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.558398 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.558338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-installation-pull-secrets\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.576518 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.576484 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f4846bd6-w4sxh"] Jul 01 19:24:07.658911 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.658888 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-bound-sa-token\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.659026 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.658917 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-image-registry-private-configuration\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.659026 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.658944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-image-registry-private-configuration\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.659026 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.658963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-registry-tls\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.659026 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkfwb\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-kube-api-access-wkfwb\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.659217 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-registry-certificates\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.659217 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-installation-pull-secrets\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.659217 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fddfw\" (UniqueName: \"kubernetes.io/projected/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-kube-api-access-fddfw\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.659217 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5a13814-6b82-430a-90e4-dfaa6899175b-ca-trust-extracted\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.660533 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-bound-sa-token\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.660533 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-tls\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.660533 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-installation-pull-secrets\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.660533 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659938 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-trusted-ca\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.660533 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5a13814-6b82-430a-90e4-dfaa6899175b-ca-trust-extracted\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.660533 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.659979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-ca-trust-extracted\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.660533 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.660014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-trusted-ca\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.660533 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.660080 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-certificates\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.661142 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.661119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-certificates\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.662379 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.662335 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-image-registry-private-configuration\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.664052 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.663917 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-tls\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.665500 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.665478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-trusted-ca\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.665642 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.665619 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-installation-pull-secrets\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.673884 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.673864 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-bound-sa-token\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.674478 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.674458 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkfwb\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-kube-api-access-wkfwb\") pod \"image-registry-67dd756b7d-ddtpf\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.757464 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.757444 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.760640 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.760619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fddfw\" (UniqueName: \"kubernetes.io/projected/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-kube-api-access-fddfw\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.760744 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.760656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-bound-sa-token\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.760744 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.760702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-installation-pull-secrets\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.760744 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.760737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-ca-trust-extracted\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.760903 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.760761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-trusted-ca\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.760903 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.760825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-image-registry-private-configuration\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.760995 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.760971 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-registry-tls\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.761047 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.761013 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-registry-certificates\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.761236 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.761213 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-ca-trust-extracted\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.762144 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.762093 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-trusted-ca\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.762246 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.762167 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-registry-certificates\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.763480 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.763456 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-image-registry-private-configuration\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.763578 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.763521 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-installation-pull-secrets\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.763642 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.763620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-registry-tls\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.764236 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.764217 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:07.769944 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.769924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-bound-sa-token\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.783443 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.783419 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fddfw\" (UniqueName: \"kubernetes.io/projected/c3afe3a0-9e95-4a38-9b8e-cc6bd0991271-kube-api-access-fddfw\") pod \"image-registry-57f4846bd6-w4sxh\" (UID: \"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271\") " pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.861901 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.861881 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5a13814-6b82-430a-90e4-dfaa6899175b-ca-trust-extracted\") pod \"a5a13814-6b82-430a-90e4-dfaa6899175b\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " Jul 01 19:24:07.861986 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.861907 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-tls\") pod \"a5a13814-6b82-430a-90e4-dfaa6899175b\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " Jul 01 19:24:07.861986 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.861927 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-installation-pull-secrets\") pod \"a5a13814-6b82-430a-90e4-dfaa6899175b\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " Jul 01 19:24:07.861986 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.861965 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkfwb\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-kube-api-access-wkfwb\") pod \"a5a13814-6b82-430a-90e4-dfaa6899175b\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " Jul 01 19:24:07.862084 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.861988 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-image-registry-private-configuration\") pod \"a5a13814-6b82-430a-90e4-dfaa6899175b\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " Jul 01 19:24:07.862084 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.862047 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-trusted-ca\") pod \"a5a13814-6b82-430a-90e4-dfaa6899175b\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " Jul 01 19:24:07.862084 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.862074 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-certificates\") pod \"a5a13814-6b82-430a-90e4-dfaa6899175b\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " Jul 01 19:24:07.862220 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.862097 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-bound-sa-token\") pod \"a5a13814-6b82-430a-90e4-dfaa6899175b\" (UID: \"a5a13814-6b82-430a-90e4-dfaa6899175b\") " Jul 01 19:24:07.862220 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.862122 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5a13814-6b82-430a-90e4-dfaa6899175b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a5a13814-6b82-430a-90e4-dfaa6899175b" (UID: "a5a13814-6b82-430a-90e4-dfaa6899175b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:24:07.862329 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.862299 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5a13814-6b82-430a-90e4-dfaa6899175b-ca-trust-extracted\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:24:07.862565 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.862524 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a5a13814-6b82-430a-90e4-dfaa6899175b" (UID: "a5a13814-6b82-430a-90e4-dfaa6899175b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:24:07.862673 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.862536 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a5a13814-6b82-430a-90e4-dfaa6899175b" (UID: "a5a13814-6b82-430a-90e4-dfaa6899175b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:24:07.863772 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.863733 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:07.864023 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.863995 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a5a13814-6b82-430a-90e4-dfaa6899175b" (UID: "a5a13814-6b82-430a-90e4-dfaa6899175b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:07.864218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.864192 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-kube-api-access-wkfwb" (OuterVolumeSpecName: "kube-api-access-wkfwb") pod "a5a13814-6b82-430a-90e4-dfaa6899175b" (UID: "a5a13814-6b82-430a-90e4-dfaa6899175b"). InnerVolumeSpecName "kube-api-access-wkfwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:07.864383 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.864349 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a5a13814-6b82-430a-90e4-dfaa6899175b" (UID: "a5a13814-6b82-430a-90e4-dfaa6899175b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:07.864590 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.864571 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a5a13814-6b82-430a-90e4-dfaa6899175b" (UID: "a5a13814-6b82-430a-90e4-dfaa6899175b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:24:07.864590 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.864581 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a5a13814-6b82-430a-90e4-dfaa6899175b" (UID: "a5a13814-6b82-430a-90e4-dfaa6899175b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:24:07.962936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.962909 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-trusted-ca\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:24:07.962936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.962935 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-certificates\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:24:07.963099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.962945 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-bound-sa-token\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:24:07.963099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.962953 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-registry-tls\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:24:07.963099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.962961 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-installation-pull-secrets\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:24:07.963099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.962969 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkfwb\" (UniqueName: \"kubernetes.io/projected/a5a13814-6b82-430a-90e4-dfaa6899175b-kube-api-access-wkfwb\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:24:07.963099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.962978 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5a13814-6b82-430a-90e4-dfaa6899175b-image-registry-private-configuration\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:24:07.990908 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:07.990883 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f4846bd6-w4sxh"] Jul 01 19:24:07.994723 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:07.994696 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3afe3a0_9e95_4a38_9b8e_cc6bd0991271.slice/crio-9e8df632d8c6decb26309a1a8a86db02bb3a8a634a9a5bdbecd243b33bba4c74 WatchSource:0}: Error finding container 9e8df632d8c6decb26309a1a8a86db02bb3a8a634a9a5bdbecd243b33bba4c74: Status 404 returned error can't find the container with id 9e8df632d8c6decb26309a1a8a86db02bb3a8a634a9a5bdbecd243b33bba4c74 Jul 01 19:24:08.762531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:08.762499 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67dd756b7d-ddtpf" Jul 01 19:24:08.762916 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:08.762537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" event={"ID":"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271","Type":"ContainerStarted","Data":"70afe1e09387e3bd3e492fa38b0eeddcf2560bdee21bfa8a9550102dcd5a1663"} Jul 01 19:24:08.762916 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:08.762583 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" event={"ID":"c3afe3a0-9e95-4a38-9b8e-cc6bd0991271","Type":"ContainerStarted","Data":"9e8df632d8c6decb26309a1a8a86db02bb3a8a634a9a5bdbecd243b33bba4c74"} Jul 01 19:24:08.762916 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:08.762766 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:08.787123 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:08.787081 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" podStartSLOduration=1.787066861 podStartE2EDuration="1.787066861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:08.786663691 +0000 UTC m=+93.873399552" watchObservedRunningTime="2026-07-01 19:24:08.787066861 +0000 UTC m=+93.873802720" Jul 01 19:24:08.820507 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:08.820481 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67dd756b7d-ddtpf"] Jul 01 19:24:08.822330 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:08.822311 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67dd756b7d-ddtpf"] Jul 01 19:24:09.408141 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:09.408111 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5a13814-6b82-430a-90e4-dfaa6899175b" path="/var/lib/kubelet/pods/a5a13814-6b82-430a-90e4-dfaa6899175b/volumes" Jul 01 19:24:09.977530 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:09.977495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:24:09.981067 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:09.981035 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/363376e8-8b45-4ae0-8fd8-4150d1915f4c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vsvjt\" (UID: \"363376e8-8b45-4ae0-8fd8-4150d1915f4c\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:24:10.272467 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:10.272436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" Jul 01 19:24:10.419770 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:10.419748 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt"] Jul 01 19:24:10.422038 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:10.422011 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363376e8_8b45_4ae0_8fd8_4150d1915f4c.slice/crio-e27930e768ff15e971f5f20ac6ae6bf834be4f3441ea42dc1c9b3036ca8fda71 WatchSource:0}: Error finding container e27930e768ff15e971f5f20ac6ae6bf834be4f3441ea42dc1c9b3036ca8fda71: Status 404 returned error can't find the container with id e27930e768ff15e971f5f20ac6ae6bf834be4f3441ea42dc1c9b3036ca8fda71 Jul 01 19:24:10.769487 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:10.769455 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" event={"ID":"363376e8-8b45-4ae0-8fd8-4150d1915f4c","Type":"ContainerStarted","Data":"e27930e768ff15e971f5f20ac6ae6bf834be4f3441ea42dc1c9b3036ca8fda71"} Jul 01 19:24:12.666935 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.666900 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5"] Jul 01 19:24:12.668764 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.668750 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" Jul 01 19:24:12.673606 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.673577 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lfswq\"" Jul 01 19:24:12.673878 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.673864 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 19:24:12.685827 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.685804 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5"] Jul 01 19:24:12.777123 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.777095 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" event={"ID":"363376e8-8b45-4ae0-8fd8-4150d1915f4c","Type":"ContainerStarted","Data":"b4ba6ec5dc770b5d55c18a24d69f3ff7c2eaed4d40f26f5e103a6421a2c818bc"} Jul 01 19:24:12.799584 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.799557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0cdb357-3002-4e60-b595-085d6e366807-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-lbnh5\" (UID: \"e0cdb357-3002-4e60-b595-085d6e366807\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" Jul 01 19:24:12.801052 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.801015 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vsvjt" podStartSLOduration=33.082288919 podStartE2EDuration="34.80100124s" totalImagesPullingTime="1.718712321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:12.800113095 +0000 UTC m=+97.886848956" watchObservedRunningTime="2026-07-01 19:24:12.80100124 +0000 UTC m=+97.887737101" Jul 01 19:24:12.900688 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.900661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0cdb357-3002-4e60-b595-085d6e366807-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-lbnh5\" (UID: \"e0cdb357-3002-4e60-b595-085d6e366807\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" Jul 01 19:24:12.903136 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.903113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0cdb357-3002-4e60-b595-085d6e366807-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-lbnh5\" (UID: \"e0cdb357-3002-4e60-b595-085d6e366807\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" Jul 01 19:24:12.978319 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:12.978262 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" Jul 01 19:24:13.098092 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:13.098038 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5"] Jul 01 19:24:13.100664 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:13.100641 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0cdb357_3002_4e60_b595_085d6e366807.slice/crio-2613f7b66af43d3baccf279f96daf2d18f2f52a90c9d31798cc49b54ddf73dff WatchSource:0}: Error finding container 2613f7b66af43d3baccf279f96daf2d18f2f52a90c9d31798cc49b54ddf73dff: Status 404 returned error can't find the container with id 2613f7b66af43d3baccf279f96daf2d18f2f52a90c9d31798cc49b54ddf73dff Jul 01 19:24:13.403692 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:13.403663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:24:13.406106 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:13.406082 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b2486a-f99b-464d-bd3e-4324394f88cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqkbd\" (UID: \"44b2486a-f99b-464d-bd3e-4324394f88cc\") " pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:24:13.666425 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:13.666325 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pqkbd" Jul 01 19:24:13.781447 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:13.781413 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" event={"ID":"e0cdb357-3002-4e60-b595-085d6e366807","Type":"ContainerStarted","Data":"2613f7b66af43d3baccf279f96daf2d18f2f52a90c9d31798cc49b54ddf73dff"} Jul 01 19:24:13.797072 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:13.797047 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pqkbd"] Jul 01 19:24:13.799968 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:13.799944 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b2486a_f99b_464d_bd3e_4324394f88cc.slice/crio-ff2ce4b6d53bc215ba17813ed037c911e256ad0cc889190186e5e953f3238515 WatchSource:0}: Error finding container ff2ce4b6d53bc215ba17813ed037c911e256ad0cc889190186e5e953f3238515: Status 404 returned error can't find the container with id ff2ce4b6d53bc215ba17813ed037c911e256ad0cc889190186e5e953f3238515 Jul 01 19:24:14.787051 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:14.787013 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqkbd" event={"ID":"44b2486a-f99b-464d-bd3e-4324394f88cc","Type":"ContainerStarted","Data":"ff2ce4b6d53bc215ba17813ed037c911e256ad0cc889190186e5e953f3238515"} Jul 01 19:24:15.218455 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.218424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:24:15.221031 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.221008 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9eff814-7447-4424-a1db-78f99451f0ad-metrics-tls\") pod \"dns-default-k2dw2\" (UID: \"c9eff814-7447-4424-a1db-78f99451f0ad\") " pod="openshift-dns/dns-default-k2dw2" Jul 01 19:24:15.227137 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.227053 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rdgrk\"" Jul 01 19:24:15.235253 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.235235 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k2dw2" Jul 01 19:24:15.394211 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.394130 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k2dw2"] Jul 01 19:24:15.397316 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:15.397274 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9eff814_7447_4424_a1db_78f99451f0ad.slice/crio-1ce175135b908cfdf8a19227155e0dd5ca1b658a3fb6ac932d2be4c48f15f141 WatchSource:0}: Error finding container 1ce175135b908cfdf8a19227155e0dd5ca1b658a3fb6ac932d2be4c48f15f141: Status 404 returned error can't find the container with id 1ce175135b908cfdf8a19227155e0dd5ca1b658a3fb6ac932d2be4c48f15f141 Jul 01 19:24:15.792515 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.792477 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" event={"ID":"e0cdb357-3002-4e60-b595-085d6e366807","Type":"ContainerStarted","Data":"14a85c530068676fa888276a84d1035eab8f8ef35a1baf50cb2cd9d88997ebd6"} Jul 01 19:24:15.792984 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.792673 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" Jul 01 19:24:15.794016 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.793982 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k2dw2" event={"ID":"c9eff814-7447-4424-a1db-78f99451f0ad","Type":"ContainerStarted","Data":"1ce175135b908cfdf8a19227155e0dd5ca1b658a3fb6ac932d2be4c48f15f141"} Jul 01 19:24:15.799110 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.799088 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" Jul 01 19:24:15.813211 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:15.813172 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-lbnh5" podStartSLOduration=1.769375225 podStartE2EDuration="3.813155936s" totalImagesPullingTime="2.043780711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:15.812115022 +0000 UTC m=+100.898850883" watchObservedRunningTime="2026-07-01 19:24:15.813155936 +0000 UTC m=+100.899891798" Jul 01 19:24:16.707201 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:16.707160 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-f82s4"] Jul 01 19:24:16.910981 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:16.910949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-f82s4"] Jul 01 19:24:16.911409 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:16.911042 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:16.913778 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:16.913757 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 19:24:16.913897 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:16.913833 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 19:24:16.913961 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:16.913931 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:24:16.914018 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:16.913980 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lhw2m\"" Jul 01 19:24:17.035694 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.035662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmgn6\" (UniqueName: \"kubernetes.io/projected/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-kube-api-access-tmgn6\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.035834 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.035716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.035834 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.035811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.035906 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.035841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.136715 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.136679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.136715 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.136725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.136955 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.136929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmgn6\" (UniqueName: \"kubernetes.io/projected/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-kube-api-access-tmgn6\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.137021 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.136990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.137119 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:24:17.137104 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 19:24:17.137193 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:24:17.137178 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-prometheus-operator-tls podName:2780e4fd-7f90-47a5-a4bb-acf94b7947bc nodeName:}" failed. No retries permitted until 2026-07-01 19:24:17.637157543 +0000 UTC m=+102.723893381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-f82s4" (UID: "2780e4fd-7f90-47a5-a4bb-acf94b7947bc") : secret "prometheus-operator-tls" not found Jul 01 19:24:17.137499 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.137408 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.139459 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.139431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.146177 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.146153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmgn6\" (UniqueName: \"kubernetes.io/projected/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-kube-api-access-tmgn6\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.643944 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.643909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.646891 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.646860 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2780e4fd-7f90-47a5-a4bb-acf94b7947bc-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-f82s4\" (UID: \"2780e4fd-7f90-47a5-a4bb-acf94b7947bc\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:17.820548 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:17.820515 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" Jul 01 19:24:18.318298 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:18.318271 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-f82s4"] Jul 01 19:24:18.436879 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:18.436847 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2780e4fd_7f90_47a5_a4bb_acf94b7947bc.slice/crio-b97ecb0bd44989b2bab8b24b2b0e568e7b1bb7270e409b2d7a23cea69462fb43 WatchSource:0}: Error finding container b97ecb0bd44989b2bab8b24b2b0e568e7b1bb7270e409b2d7a23cea69462fb43: Status 404 returned error can't find the container with id b97ecb0bd44989b2bab8b24b2b0e568e7b1bb7270e409b2d7a23cea69462fb43 Jul 01 19:24:18.697094 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:18.697067 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vw4mh" Jul 01 19:24:18.807345 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:18.807303 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" event={"ID":"2780e4fd-7f90-47a5-a4bb-acf94b7947bc","Type":"ContainerStarted","Data":"b97ecb0bd44989b2bab8b24b2b0e568e7b1bb7270e409b2d7a23cea69462fb43"} Jul 01 19:24:19.814459 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:19.814419 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k2dw2" event={"ID":"c9eff814-7447-4424-a1db-78f99451f0ad","Type":"ContainerStarted","Data":"5144801bf707c159e406bbaf2fd035a603f050c317318a0f536fff0bf5907381"} Jul 01 19:24:19.814914 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:19.814501 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k2dw2" Jul 01 19:24:19.814914 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:19.814526 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k2dw2" event={"ID":"c9eff814-7447-4424-a1db-78f99451f0ad","Type":"ContainerStarted","Data":"ff228c1bc6e32e27a4df4e74e46f54960621034f233d37a13b39d17351d4ac68"} Jul 01 19:24:19.816154 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:19.816124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqkbd" event={"ID":"44b2486a-f99b-464d-bd3e-4324394f88cc","Type":"ContainerStarted","Data":"aa14a74bd699f1ce70c9406f5d914da62e763619ee52b287ca404d2d0a5fdd8b"} Jul 01 19:24:19.834984 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:19.834940 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k2dw2" podStartSLOduration=65.0177124 podStartE2EDuration="1m8.834924094s" totalImagesPullingTime="3.817211694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:19.833927267 +0000 UTC m=+104.920663128" watchObservedRunningTime="2026-07-01 19:24:19.834924094 +0000 UTC m=+104.921659936" Jul 01 19:24:20.826794 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:20.826756 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqkbd" event={"ID":"44b2486a-f99b-464d-bd3e-4324394f88cc","Type":"ContainerStarted","Data":"f1f4b8d50952de0cebe8878824e224454e03c060cbe80f342b65903160a30136"} Jul 01 19:24:20.828932 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:20.828893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" event={"ID":"2780e4fd-7f90-47a5-a4bb-acf94b7947bc","Type":"ContainerStarted","Data":"110c78e2bd90c12ccbb0a1de96a96424962fd067007a46f10b3ae025f64c0912"} Jul 01 19:24:20.829050 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:20.828949 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" event={"ID":"2780e4fd-7f90-47a5-a4bb-acf94b7947bc","Type":"ContainerStarted","Data":"dd869033075d59425317ac3a654760d8b800899ff2b78e57184109569f3b78b2"} Jul 01 19:24:20.847331 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:20.847277 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-f82s4" podStartSLOduration=3.168679347 podStartE2EDuration="4.847257391s" totalImagesPullingTime="1.678578044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:20.846056943 +0000 UTC m=+105.932792803" watchObservedRunningTime="2026-07-01 19:24:20.847257391 +0000 UTC m=+105.933993448" Jul 01 19:24:22.837830 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:22.837796 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqkbd" event={"ID":"44b2486a-f99b-464d-bd3e-4324394f88cc","Type":"ContainerStarted","Data":"b94caa42a91e257d03660b5fcbaf2e07da02bfa9484c39ccf098d0c0c533ba1a"} Jul 01 19:24:22.857544 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:22.857496 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pqkbd" podStartSLOduration=33.055257143 podStartE2EDuration="41.857477747s" totalImagesPullingTime="8.802220604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:22.857248123 +0000 UTC m=+107.943983975" watchObservedRunningTime="2026-07-01 19:24:22.857477747 +0000 UTC m=+107.944213608" Jul 01 19:24:23.062441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.062347 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-n4rsq"] Jul 01 19:24:23.065108 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.065091 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.067726 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.067662 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 19:24:23.067726 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.067678 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:24:23.068168 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.068144 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 19:24:23.068278 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.068173 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jhmcz\"" Jul 01 19:24:23.077537 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.077517 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-n4rsq"] Jul 01 19:24:23.084500 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.084480 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kdhhs"] Jul 01 19:24:23.085438 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.085414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.085545 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.085454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4n58\" (UniqueName: \"kubernetes.io/projected/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-api-access-f4n58\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.085545 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.085517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d6722b1-2e36-467a-99e8-c8c8102a0df5-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.085663 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.085550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.085663 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.085584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.085663 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.085650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d6722b1-2e36-467a-99e8-c8c8102a0df5-metrics-client-ca\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.086966 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.086952 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.089434 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.089416 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:24:23.089723 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.089672 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:24:23.089832 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.089788 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:24:23.089891 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.089846 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bfs88\"" Jul 01 19:24:23.186225 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.186225 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-accelerators-collector-config\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.186448 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-textfile\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.186448 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d6722b1-2e36-467a-99e8-c8c8102a0df5-metrics-client-ca\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.186448 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-tls\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.186565 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcpmq\" (UniqueName: \"kubernetes.io/projected/0081e0c7-c1c2-4ef0-8234-a907741ce270-kube-api-access-mcpmq\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.186565 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186509 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0081e0c7-c1c2-4ef0-8234-a907741ce270-root\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.186565 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186542 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.186707 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4n58\" (UniqueName: \"kubernetes.io/projected/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-api-access-f4n58\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.186707 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-wtmp\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.186707 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.186707 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186661 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0081e0c7-c1c2-4ef0-8234-a907741ce270-metrics-client-ca\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.186707 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186700 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d6722b1-2e36-467a-99e8-c8c8102a0df5-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.186956 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186744 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.186956 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.186775 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0081e0c7-c1c2-4ef0-8234-a907741ce270-sys\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.187060 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.187022 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d6722b1-2e36-467a-99e8-c8c8102a0df5-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.187134 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.187114 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d6722b1-2e36-467a-99e8-c8c8102a0df5-metrics-client-ca\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.187248 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.187227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.189237 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.189211 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.189484 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.189464 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.196604 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.196583 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4n58\" (UniqueName: \"kubernetes.io/projected/3d6722b1-2e36-467a-99e8-c8c8102a0df5-kube-api-access-f4n58\") pod \"kube-state-metrics-845b954455-n4rsq\" (UID: \"3d6722b1-2e36-467a-99e8-c8c8102a0df5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.287103 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-wtmp\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0081e0c7-c1c2-4ef0-8234-a907741ce270-metrics-client-ca\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287209 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0081e0c7-c1c2-4ef0-8234-a907741ce270-sys\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-wtmp\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-accelerators-collector-config\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-textfile\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-tls\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcpmq\" (UniqueName: \"kubernetes.io/projected/0081e0c7-c1c2-4ef0-8234-a907741ce270-kube-api-access-mcpmq\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287463 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0081e0c7-c1c2-4ef0-8234-a907741ce270-sys\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287485 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0081e0c7-c1c2-4ef0-8234-a907741ce270-root\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:24:23.287555 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:24:23.287614 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-tls podName:0081e0c7-c1c2-4ef0-8234-a907741ce270 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:23.787597267 +0000 UTC m=+108.874333106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-tls") pod "node-exporter-kdhhs" (UID: "0081e0c7-c1c2-4ef0-8234-a907741ce270") : secret "node-exporter-tls" not found Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287554 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0081e0c7-c1c2-4ef0-8234-a907741ce270-root\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.287964 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.287718 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0081e0c7-c1c2-4ef0-8234-a907741ce270-metrics-client-ca\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.288592 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.288208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-textfile\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.288592 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.288374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-accelerators-collector-config\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.290720 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.290701 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.297995 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.297975 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcpmq\" (UniqueName: \"kubernetes.io/projected/0081e0c7-c1c2-4ef0-8234-a907741ce270-kube-api-access-mcpmq\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.376442 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.376391 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" Jul 01 19:24:23.513462 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.513438 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-n4rsq"] Jul 01 19:24:23.516061 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:23.516028 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6722b1_2e36_467a_99e8_c8c8102a0df5.slice/crio-6203a20bdebde5562c07f427f8f78fc2ee9fb6ad9f94f0cdde331203e6db106e WatchSource:0}: Error finding container 6203a20bdebde5562c07f427f8f78fc2ee9fb6ad9f94f0cdde331203e6db106e: Status 404 returned error can't find the container with id 6203a20bdebde5562c07f427f8f78fc2ee9fb6ad9f94f0cdde331203e6db106e Jul 01 19:24:23.791854 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.791825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-tls\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.794193 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.794167 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0081e0c7-c1c2-4ef0-8234-a907741ce270-node-exporter-tls\") pod \"node-exporter-kdhhs\" (UID: \"0081e0c7-c1c2-4ef0-8234-a907741ce270\") " pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:23.844427 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.844393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" event={"ID":"3d6722b1-2e36-467a-99e8-c8c8102a0df5","Type":"ContainerStarted","Data":"6203a20bdebde5562c07f427f8f78fc2ee9fb6ad9f94f0cdde331203e6db106e"} Jul 01 19:24:23.996169 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:23.996140 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kdhhs" Jul 01 19:24:24.006199 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:24.006169 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0081e0c7_c1c2_4ef0_8234_a907741ce270.slice/crio-19e695d3fe9c9e642d08e4afed0bcfaabada11da3ec46ca547a123030b539552 WatchSource:0}: Error finding container 19e695d3fe9c9e642d08e4afed0bcfaabada11da3ec46ca547a123030b539552: Status 404 returned error can't find the container with id 19e695d3fe9c9e642d08e4afed0bcfaabada11da3ec46ca547a123030b539552 Jul 01 19:24:24.155912 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.155845 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:24:24.159113 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.159095 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.167936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.167797 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 19:24:24.167936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.167811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 19:24:24.167936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.167823 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 19:24:24.167936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.167834 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 19:24:24.167936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.167875 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 19:24:24.167936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.167823 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 19:24:24.167936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.167920 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6vc7v\"" Jul 01 19:24:24.168412 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.168240 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 19:24:24.168412 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.168353 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 19:24:24.168572 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.168560 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 19:24:24.179665 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.179644 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:24:24.198154 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198250 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198250 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198316 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198316 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198387 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198317 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbf84\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-kube-api-access-gbf84\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198387 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-web-config\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198451 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198481 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198515 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-volume\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198515 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198574 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-out\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.198574 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.198545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299036 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-volume\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-out\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299394 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299553 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299553 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299421 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299553 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf84\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-kube-api-access-gbf84\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299553 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-web-config\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299553 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.299553 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.299540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.300349 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.300131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.300707 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.300682 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.301457 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.301429 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.303383 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.303316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-volume\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.304010 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.303991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-out\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.304146 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.303999 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.304225 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.304093 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-web-config\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.304312 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.304231 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.304491 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.304475 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.304617 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.304582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.304714 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.304662 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.306334 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.306284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.308686 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.308668 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbf84\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-kube-api-access-gbf84\") pod \"alertmanager-main-0\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.468573 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.468502 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:24:24.626907 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.626876 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:24:24.630620 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:24.630580 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4632f459_30ed_48cd_b9cb_5a05641f1e42.slice/crio-2b78e4d63f8c28fba3d93178ae605f0959426c65ec7b20c556c5ca707fce826b WatchSource:0}: Error finding container 2b78e4d63f8c28fba3d93178ae605f0959426c65ec7b20c556c5ca707fce826b: Status 404 returned error can't find the container with id 2b78e4d63f8c28fba3d93178ae605f0959426c65ec7b20c556c5ca707fce826b Jul 01 19:24:24.850878 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.850836 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerStarted","Data":"2b78e4d63f8c28fba3d93178ae605f0959426c65ec7b20c556c5ca707fce826b"} Jul 01 19:24:24.852969 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:24.852937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdhhs" event={"ID":"0081e0c7-c1c2-4ef0-8234-a907741ce270","Type":"ContainerStarted","Data":"19e695d3fe9c9e642d08e4afed0bcfaabada11da3ec46ca547a123030b539552"} Jul 01 19:24:25.859481 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:25.859436 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" event={"ID":"3d6722b1-2e36-467a-99e8-c8c8102a0df5","Type":"ContainerStarted","Data":"e7a08693f116700cf1b94debc71128e99393c90baa31a0b804595c35f66e09f3"} Jul 01 19:24:25.859896 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:25.859549 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" event={"ID":"3d6722b1-2e36-467a-99e8-c8c8102a0df5","Type":"ContainerStarted","Data":"2666d27aaf8379d2f583e0c8fbf937fc41003c36d01556d67d26f3ad7d2ad71b"} Jul 01 19:24:25.859896 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:25.859585 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" event={"ID":"3d6722b1-2e36-467a-99e8-c8c8102a0df5","Type":"ContainerStarted","Data":"c9388e9d0bac67c8143b4ffecf5a8050f30c95f9036083f146d6ea861d0bc0d0"} Jul 01 19:24:25.861085 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:25.861061 2565 generic.go:356] "Generic (PLEG): container finished" podID="0081e0c7-c1c2-4ef0-8234-a907741ce270" containerID="712af3205141232064f62df5d71e79e0ab94717728d105185bd71ec1d194428a" exitCode=0 Jul 01 19:24:25.861202 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:25.861094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdhhs" event={"ID":"0081e0c7-c1c2-4ef0-8234-a907741ce270","Type":"ContainerDied","Data":"712af3205141232064f62df5d71e79e0ab94717728d105185bd71ec1d194428a"} Jul 01 19:24:25.883482 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:25.883133 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-n4rsq" podStartSLOduration=1.067047497 podStartE2EDuration="2.88311495s" totalImagesPullingTime="1.816067453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:25.880545773 +0000 UTC m=+110.967281634" watchObservedRunningTime="2026-07-01 19:24:25.88311495 +0000 UTC m=+110.969850810" Jul 01 19:24:26.866241 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:26.866203 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdhhs" event={"ID":"0081e0c7-c1c2-4ef0-8234-a907741ce270","Type":"ContainerStarted","Data":"c509312b9719cb02926bcee5d251cc1818648b5a694386e8ca87ffdfd114cd82"} Jul 01 19:24:26.866678 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:26.866267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdhhs" event={"ID":"0081e0c7-c1c2-4ef0-8234-a907741ce270","Type":"ContainerStarted","Data":"6ab9da90c169a188a51b1d3c641afb81072a5efc4fec5590106cedaa412b254b"} Jul 01 19:24:26.867574 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:26.867550 2565 generic.go:356] "Generic (PLEG): container finished" podID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerID="55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6" exitCode=0 Jul 01 19:24:26.867692 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:26.867628 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerDied","Data":"55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6"} Jul 01 19:24:26.889101 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:26.889057 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kdhhs" podStartSLOduration=2.473754222 podStartE2EDuration="3.889038788s" totalImagesPullingTime="1.326803016s" totalInitContainerRuntime="88.48155ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:26.887872021 +0000 UTC m=+111.974607884" watchObservedRunningTime="2026-07-01 19:24:26.889038788 +0000 UTC m=+111.975774649" Jul 01 19:24:27.838097 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:27.838066 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-qpggr"] Jul 01 19:24:27.840891 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:27.840870 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:27.843771 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:27.843752 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rd587\"" Jul 01 19:24:27.843953 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:27.843940 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 19:24:27.850865 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:27.850534 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-qpggr"] Jul 01 19:24:27.869867 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:27.869835 2565 patch_prober.go:28] interesting pod/image-registry-57f4846bd6-w4sxh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 19:24:27.870211 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:27.869891 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" podUID="c3afe3a0-9e95-4a38-9b8e-cc6bd0991271" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:24:27.931705 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:27.931675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzzxj\" (UniqueName: \"kubernetes.io/projected/2295b78a-aad4-4ef5-8483-63d09b18f80e-kube-api-access-tzzxj\") pod \"monitoring-plugin-cd8656b8-qpggr\" (UID: \"2295b78a-aad4-4ef5-8483-63d09b18f80e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:27.936346 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:27.932240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2295b78a-aad4-4ef5-8483-63d09b18f80e-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-qpggr\" (UID: \"2295b78a-aad4-4ef5-8483-63d09b18f80e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:28.033683 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.033649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzzxj\" (UniqueName: \"kubernetes.io/projected/2295b78a-aad4-4ef5-8483-63d09b18f80e-kube-api-access-tzzxj\") pod \"monitoring-plugin-cd8656b8-qpggr\" (UID: \"2295b78a-aad4-4ef5-8483-63d09b18f80e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:28.033864 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.033737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2295b78a-aad4-4ef5-8483-63d09b18f80e-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-qpggr\" (UID: \"2295b78a-aad4-4ef5-8483-63d09b18f80e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:28.033924 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:24:28.033887 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 01 19:24:28.033975 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:24:28.033932 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2295b78a-aad4-4ef5-8483-63d09b18f80e-monitoring-plugin-cert podName:2295b78a-aad4-4ef5-8483-63d09b18f80e nodeName:}" failed. No retries permitted until 2026-07-01 19:24:28.533918833 +0000 UTC m=+113.620654671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2295b78a-aad4-4ef5-8483-63d09b18f80e-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-qpggr" (UID: "2295b78a-aad4-4ef5-8483-63d09b18f80e") : secret "monitoring-plugin-cert" not found Jul 01 19:24:28.045156 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.045123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzzxj\" (UniqueName: \"kubernetes.io/projected/2295b78a-aad4-4ef5-8483-63d09b18f80e-kube-api-access-tzzxj\") pod \"monitoring-plugin-cd8656b8-qpggr\" (UID: \"2295b78a-aad4-4ef5-8483-63d09b18f80e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:28.538227 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.538191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2295b78a-aad4-4ef5-8483-63d09b18f80e-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-qpggr\" (UID: \"2295b78a-aad4-4ef5-8483-63d09b18f80e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:28.543005 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.542538 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2295b78a-aad4-4ef5-8483-63d09b18f80e-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-qpggr\" (UID: \"2295b78a-aad4-4ef5-8483-63d09b18f80e\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:28.754482 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.754456 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:28.879745 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.879721 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerStarted","Data":"98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2"} Jul 01 19:24:28.880069 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.879835 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerStarted","Data":"514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e"} Jul 01 19:24:28.880069 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.879881 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerStarted","Data":"b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd"} Jul 01 19:24:28.903691 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:28.903667 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-qpggr"] Jul 01 19:24:28.909738 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:28.909715 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2295b78a_aad4_4ef5_8483_63d09b18f80e.slice/crio-452b6a5dcaab583b88a6a7151e6cea1b50bb0eb6b81e6ed1321817503c57f045 WatchSource:0}: Error finding container 452b6a5dcaab583b88a6a7151e6cea1b50bb0eb6b81e6ed1321817503c57f045: Status 404 returned error can't find the container with id 452b6a5dcaab583b88a6a7151e6cea1b50bb0eb6b81e6ed1321817503c57f045 Jul 01 19:24:29.771926 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:29.771898 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57f4846bd6-w4sxh" Jul 01 19:24:29.831100 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:29.831073 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k2dw2" Jul 01 19:24:29.887414 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:29.887376 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" event={"ID":"2295b78a-aad4-4ef5-8483-63d09b18f80e","Type":"ContainerStarted","Data":"452b6a5dcaab583b88a6a7151e6cea1b50bb0eb6b81e6ed1321817503c57f045"} Jul 01 19:24:29.891728 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:29.891699 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerStarted","Data":"d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023"} Jul 01 19:24:29.891853 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:29.891772 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerStarted","Data":"f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66"} Jul 01 19:24:30.902820 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:30.902781 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerStarted","Data":"42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49"} Jul 01 19:24:30.904168 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:30.904149 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" event={"ID":"2295b78a-aad4-4ef5-8483-63d09b18f80e","Type":"ContainerStarted","Data":"58149f7c4e2d7de4f52b1f1fc25cd7741132d8300c8d74de1cba16bb200c5773"} Jul 01 19:24:30.904372 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:30.904338 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:30.908680 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:30.908653 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" Jul 01 19:24:30.942036 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:30.941997 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.601112586 podStartE2EDuration="6.941984645s" totalImagesPullingTime="4.316297358s" totalInitContainerRuntime="24.574701ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:30.941315458 +0000 UTC m=+116.028051318" watchObservedRunningTime="2026-07-01 19:24:30.941984645 +0000 UTC m=+116.028720505" Jul 01 19:24:30.961110 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:30.961071 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-qpggr" podStartSLOduration=2.392366435 podStartE2EDuration="3.961057709s" totalImagesPullingTime="1.568691274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:30.959961247 +0000 UTC m=+116.046697104" watchObservedRunningTime="2026-07-01 19:24:30.961057709 +0000 UTC m=+116.047793569" Jul 01 19:24:37.142772 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.142736 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58c5fd4547-r8qv9"] Jul 01 19:24:37.145613 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.145593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.149586 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.149567 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 19:24:37.149695 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.149569 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g7lzs\"" Jul 01 19:24:37.149864 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.149843 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 19:24:37.149864 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.149859 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 19:24:37.149864 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.149865 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 19:24:37.150035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.149862 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 19:24:37.150152 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.150138 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 19:24:37.150209 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.150163 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 19:24:37.156129 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.156111 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c5fd4547-r8qv9"] Jul 01 19:24:37.214013 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.213983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-console-config\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.214147 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.214054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbpsk\" (UniqueName: \"kubernetes.io/projected/e69cfe07-399e-4cf2-bd39-54437038db7b-kube-api-access-bbpsk\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.214147 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.214141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-serving-cert\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.214268 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.214173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-oauth-config\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.214268 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.214203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-service-ca\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.214268 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.214233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-oauth-serving-cert\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.314667 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.314629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-serving-cert\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.314667 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.314672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-oauth-config\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.314818 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.314693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-service-ca\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.314818 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.314720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-oauth-serving-cert\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.314818 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.314754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-console-config\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.314818 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.314816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbpsk\" (UniqueName: \"kubernetes.io/projected/e69cfe07-399e-4cf2-bd39-54437038db7b-kube-api-access-bbpsk\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.315508 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.315488 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-console-config\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.315601 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.315494 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-oauth-serving-cert\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.315601 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.315494 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-service-ca\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.317086 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.317060 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-serving-cert\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.317171 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.317113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-oauth-config\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.323144 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.323122 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbpsk\" (UniqueName: \"kubernetes.io/projected/e69cfe07-399e-4cf2-bd39-54437038db7b-kube-api-access-bbpsk\") pod \"console-58c5fd4547-r8qv9\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.455168 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.455093 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:37.581934 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.581902 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c5fd4547-r8qv9"] Jul 01 19:24:37.584948 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:37.584925 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69cfe07_399e_4cf2_bd39_54437038db7b.slice/crio-30a6d759999fa4f0f030c3a75c1d29e0987b9235cf8e505f68c16a6dcf0277b4 WatchSource:0}: Error finding container 30a6d759999fa4f0f030c3a75c1d29e0987b9235cf8e505f68c16a6dcf0277b4: Status 404 returned error can't find the container with id 30a6d759999fa4f0f030c3a75c1d29e0987b9235cf8e505f68c16a6dcf0277b4 Jul 01 19:24:37.930951 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:37.930914 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c5fd4547-r8qv9" event={"ID":"e69cfe07-399e-4cf2-bd39-54437038db7b","Type":"ContainerStarted","Data":"30a6d759999fa4f0f030c3a75c1d29e0987b9235cf8e505f68c16a6dcf0277b4"} Jul 01 19:24:40.949508 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:40.948623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c5fd4547-r8qv9" event={"ID":"e69cfe07-399e-4cf2-bd39-54437038db7b","Type":"ContainerStarted","Data":"1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e"} Jul 01 19:24:40.970264 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:40.970212 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58c5fd4547-r8qv9" podStartSLOduration=0.740614684 podStartE2EDuration="3.970193785s" totalImagesPullingTime="3.229579101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:40.968469002 +0000 UTC m=+126.055204864" watchObservedRunningTime="2026-07-01 19:24:40.970193785 +0000 UTC m=+126.056929644" Jul 01 19:24:45.289499 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:45.289470 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:24:45.291828 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:45.291808 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0732f1f3-9b70-4a07-b1a7-2ce3d36291e3-metrics-certs\") pod \"network-metrics-daemon-rh76h\" (UID: \"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3\") " pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:24:45.321857 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:45.321829 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsxvz\"" Jul 01 19:24:45.329856 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:45.329839 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh76h" Jul 01 19:24:45.467763 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:45.467734 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rh76h"] Jul 01 19:24:45.471009 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:45.470981 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0732f1f3_9b70_4a07_b1a7_2ce3d36291e3.slice/crio-92ff50283e4f427c7f5ce224328505b11ae3f6a6ec43b1edec1d9949921648a3 WatchSource:0}: Error finding container 92ff50283e4f427c7f5ce224328505b11ae3f6a6ec43b1edec1d9949921648a3: Status 404 returned error can't find the container with id 92ff50283e4f427c7f5ce224328505b11ae3f6a6ec43b1edec1d9949921648a3 Jul 01 19:24:45.967935 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:45.967895 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh76h" event={"ID":"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3","Type":"ContainerStarted","Data":"92ff50283e4f427c7f5ce224328505b11ae3f6a6ec43b1edec1d9949921648a3"} Jul 01 19:24:46.935508 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:46.935474 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69c5b5bf79-s5vq8"] Jul 01 19:24:46.946967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:46.946937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:46.954864 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:46.954841 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c5b5bf79-s5vq8"] Jul 01 19:24:46.955713 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:46.955675 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 19:24:47.106531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.106496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-serving-cert\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.106531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.106544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-service-ca\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.106717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.106566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-oauth-config\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.106717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.106618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-oauth-serving-cert\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.106717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.106708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-config\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.106851 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.106748 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-trusted-ca-bundle\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.106851 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.106817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-545mh\" (UniqueName: \"kubernetes.io/projected/8619d8a9-08a2-4886-aa09-0cf6f4003617-kube-api-access-545mh\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.207199 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.207174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-service-ca\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.207314 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.207211 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-oauth-config\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.207314 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.207229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-oauth-serving-cert\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.207314 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.207263 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-config\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.207314 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.207286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-trusted-ca-bundle\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.207531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.207315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-545mh\" (UniqueName: \"kubernetes.io/projected/8619d8a9-08a2-4886-aa09-0cf6f4003617-kube-api-access-545mh\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.207531 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.207427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-serving-cert\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.208008 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.207984 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-service-ca\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.208114 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.207988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-config\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.208114 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.208106 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-oauth-serving-cert\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.208311 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.208290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-trusted-ca-bundle\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.210309 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.210287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-oauth-config\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.210474 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.210295 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-serving-cert\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.219953 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.219933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-545mh\" (UniqueName: \"kubernetes.io/projected/8619d8a9-08a2-4886-aa09-0cf6f4003617-kube-api-access-545mh\") pod \"console-69c5b5bf79-s5vq8\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.258899 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.258875 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:47.394423 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.394398 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c5b5bf79-s5vq8"] Jul 01 19:24:47.396707 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:24:47.396682 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8619d8a9_08a2_4886_aa09_0cf6f4003617.slice/crio-06ff0afdbf4f0a2eac2221232fc36c2e0352cdd42e66d3acce8e27d32d1bd679 WatchSource:0}: Error finding container 06ff0afdbf4f0a2eac2221232fc36c2e0352cdd42e66d3acce8e27d32d1bd679: Status 404 returned error can't find the container with id 06ff0afdbf4f0a2eac2221232fc36c2e0352cdd42e66d3acce8e27d32d1bd679 Jul 01 19:24:47.455316 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.455284 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:47.455431 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.455344 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:47.460396 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.460377 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:47.977018 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.976971 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh76h" event={"ID":"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3","Type":"ContainerStarted","Data":"aa21480df6ae3e02427ac0827a0b956af6876c49ac199da055d94957a61be9f9"} Jul 01 19:24:47.977562 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.977031 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh76h" event={"ID":"0732f1f3-9b70-4a07-b1a7-2ce3d36291e3","Type":"ContainerStarted","Data":"07d1cb305b36de169bcb3ad19082587c714f36bde3983709dca4608f260309fa"} Jul 01 19:24:47.978675 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.978647 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5b5bf79-s5vq8" event={"ID":"8619d8a9-08a2-4886-aa09-0cf6f4003617","Type":"ContainerStarted","Data":"bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4"} Jul 01 19:24:47.978766 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.978698 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5b5bf79-s5vq8" event={"ID":"8619d8a9-08a2-4886-aa09-0cf6f4003617","Type":"ContainerStarted","Data":"06ff0afdbf4f0a2eac2221232fc36c2e0352cdd42e66d3acce8e27d32d1bd679"} Jul 01 19:24:47.982291 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.982275 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:24:47.994151 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:47.994114 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rh76h" podStartSLOduration=130.515188208 podStartE2EDuration="2m11.994101275s" totalImagesPullingTime="1.478913067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:47.99259035 +0000 UTC m=+133.079326206" watchObservedRunningTime="2026-07-01 19:24:47.994101275 +0000 UTC m=+133.080837135" Jul 01 19:24:48.011234 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:48.011173 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69c5b5bf79-s5vq8" podStartSLOduration=2.011158653 podStartE2EDuration="2.011158653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:48.008796427 +0000 UTC m=+133.095532287" watchObservedRunningTime="2026-07-01 19:24:48.011158653 +0000 UTC m=+133.097894513" Jul 01 19:24:57.259141 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:57.259112 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:57.259583 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:57.259170 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:57.263693 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:57.263675 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:58.022913 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:58.022877 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:24:58.073269 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:24:58.073234 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c5fd4547-r8qv9"] Jul 01 19:25:07.055375 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:07.055338 2565 generic.go:356] "Generic (PLEG): container finished" podID="d16cf183-6132-401c-b4d0-de32c5efd8a6" containerID="4892bb1e0cb3611201610c0eb8d04e048a64217b774cec85ead53a89c4d746db" exitCode=0 Jul 01 19:25:07.055745 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:07.055402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-whnqd" event={"ID":"d16cf183-6132-401c-b4d0-de32c5efd8a6","Type":"ContainerDied","Data":"4892bb1e0cb3611201610c0eb8d04e048a64217b774cec85ead53a89c4d746db"} Jul 01 19:25:07.055745 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:07.055719 2565 scope.go:117] "RemoveContainer" containerID="4892bb1e0cb3611201610c0eb8d04e048a64217b774cec85ead53a89c4d746db" Jul 01 19:25:08.060877 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:08.060842 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-whnqd" event={"ID":"d16cf183-6132-401c-b4d0-de32c5efd8a6","Type":"ContainerStarted","Data":"68ee14a96d2a37d5ebae5029000fc63d331379541f0c07457914c532d0253989"} Jul 01 19:25:23.095859 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.095794 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58c5fd4547-r8qv9" podUID="e69cfe07-399e-4cf2-bd39-54437038db7b" containerName="console" containerID="cri-o://1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e" gracePeriod=15 Jul 01 19:25:23.343529 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.343505 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:25:23.409882 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.409805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-oauth-config\") pod \"e69cfe07-399e-4cf2-bd39-54437038db7b\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " Jul 01 19:25:23.409882 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.409845 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbpsk\" (UniqueName: \"kubernetes.io/projected/e69cfe07-399e-4cf2-bd39-54437038db7b-kube-api-access-bbpsk\") pod \"e69cfe07-399e-4cf2-bd39-54437038db7b\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " Jul 01 19:25:23.409882 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.409872 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-console-config\") pod \"e69cfe07-399e-4cf2-bd39-54437038db7b\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " Jul 01 19:25:23.410142 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.409900 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-serving-cert\") pod \"e69cfe07-399e-4cf2-bd39-54437038db7b\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " Jul 01 19:25:23.410142 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.409916 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-service-ca\") pod \"e69cfe07-399e-4cf2-bd39-54437038db7b\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " Jul 01 19:25:23.410142 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.409933 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-oauth-serving-cert\") pod \"e69cfe07-399e-4cf2-bd39-54437038db7b\" (UID: \"e69cfe07-399e-4cf2-bd39-54437038db7b\") " Jul 01 19:25:23.410413 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.410381 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-console-config" (OuterVolumeSpecName: "console-config") pod "e69cfe07-399e-4cf2-bd39-54437038db7b" (UID: "e69cfe07-399e-4cf2-bd39-54437038db7b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:23.410413 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.410398 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-service-ca" (OuterVolumeSpecName: "service-ca") pod "e69cfe07-399e-4cf2-bd39-54437038db7b" (UID: "e69cfe07-399e-4cf2-bd39-54437038db7b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:23.410551 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.410424 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e69cfe07-399e-4cf2-bd39-54437038db7b" (UID: "e69cfe07-399e-4cf2-bd39-54437038db7b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:23.412210 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.412188 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e69cfe07-399e-4cf2-bd39-54437038db7b" (UID: "e69cfe07-399e-4cf2-bd39-54437038db7b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:23.412514 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.412491 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69cfe07-399e-4cf2-bd39-54437038db7b-kube-api-access-bbpsk" (OuterVolumeSpecName: "kube-api-access-bbpsk") pod "e69cfe07-399e-4cf2-bd39-54437038db7b" (UID: "e69cfe07-399e-4cf2-bd39-54437038db7b"). InnerVolumeSpecName "kube-api-access-bbpsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:23.412514 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.412501 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e69cfe07-399e-4cf2-bd39-54437038db7b" (UID: "e69cfe07-399e-4cf2-bd39-54437038db7b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:23.510560 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.510521 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-oauth-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:23.510560 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.510557 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbpsk\" (UniqueName: \"kubernetes.io/projected/e69cfe07-399e-4cf2-bd39-54437038db7b-kube-api-access-bbpsk\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:23.510758 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.510573 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-console-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:23.510758 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.510587 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e69cfe07-399e-4cf2-bd39-54437038db7b-console-serving-cert\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:23.510758 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.510600 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-service-ca\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:23.510758 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:23.510613 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e69cfe07-399e-4cf2-bd39-54437038db7b-oauth-serving-cert\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:24.125550 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:24.125513 2565 generic.go:356] "Generic (PLEG): container finished" podID="e69cfe07-399e-4cf2-bd39-54437038db7b" containerID="1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e" exitCode=0 Jul 01 19:25:24.125946 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:24.125568 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c5fd4547-r8qv9" Jul 01 19:25:24.125946 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:24.125601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c5fd4547-r8qv9" event={"ID":"e69cfe07-399e-4cf2-bd39-54437038db7b","Type":"ContainerDied","Data":"1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e"} Jul 01 19:25:24.125946 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:24.125680 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c5fd4547-r8qv9" event={"ID":"e69cfe07-399e-4cf2-bd39-54437038db7b","Type":"ContainerDied","Data":"30a6d759999fa4f0f030c3a75c1d29e0987b9235cf8e505f68c16a6dcf0277b4"} Jul 01 19:25:24.125946 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:24.125702 2565 scope.go:117] "RemoveContainer" containerID="1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e" Jul 01 19:25:24.134420 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:24.134398 2565 scope.go:117] "RemoveContainer" containerID="1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e" Jul 01 19:25:24.134672 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:25:24.134655 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e\": container with ID starting with 1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e not found: ID does not exist" containerID="1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e" Jul 01 19:25:24.134719 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:24.134680 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e"} err="failed to get container status \"1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e\": rpc error: code = NotFound desc = could not find container \"1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e\": container with ID starting with 1292e2332d110698a674dff553a78ea1a36b7d3e2d98fda0249ad372b964986e not found: ID does not exist" Jul 01 19:25:24.145727 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:24.145702 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c5fd4547-r8qv9"] Jul 01 19:25:24.149730 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:24.149710 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58c5fd4547-r8qv9"] Jul 01 19:25:25.409090 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:25.409056 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69cfe07-399e-4cf2-bd39-54437038db7b" path="/var/lib/kubelet/pods/e69cfe07-399e-4cf2-bd39-54437038db7b/volumes" Jul 01 19:25:43.408676 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:43.408650 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:25:43.409097 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:43.408898 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="alertmanager" containerID="cri-o://b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd" gracePeriod=120 Jul 01 19:25:43.409097 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:43.408986 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy-web" containerID="cri-o://98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2" gracePeriod=120 Jul 01 19:25:43.409097 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:43.409034 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy" containerID="cri-o://f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66" gracePeriod=120 Jul 01 19:25:43.409097 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:43.409066 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="prom-label-proxy" containerID="cri-o://42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49" gracePeriod=120 Jul 01 19:25:43.409324 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:43.409113 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy-metric" containerID="cri-o://d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023" gracePeriod=120 Jul 01 19:25:43.409324 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:43.409000 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="config-reloader" containerID="cri-o://514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e" gracePeriod=120 Jul 01 19:25:44.213325 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.213293 2565 generic.go:356] "Generic (PLEG): container finished" podID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerID="42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49" exitCode=0 Jul 01 19:25:44.213325 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.213318 2565 generic.go:356] "Generic (PLEG): container finished" podID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerID="f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66" exitCode=0 Jul 01 19:25:44.213325 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.213325 2565 generic.go:356] "Generic (PLEG): container finished" podID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerID="514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e" exitCode=0 Jul 01 19:25:44.213325 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.213331 2565 generic.go:356] "Generic (PLEG): container finished" podID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerID="b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd" exitCode=0 Jul 01 19:25:44.213607 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.213351 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerDied","Data":"42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49"} Jul 01 19:25:44.213607 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.213428 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerDied","Data":"f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66"} Jul 01 19:25:44.213607 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.213456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerDied","Data":"514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e"} Jul 01 19:25:44.213607 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.213480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerDied","Data":"b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd"} Jul 01 19:25:44.755536 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.755512 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:44.889841 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.889794 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-trusted-ca-bundle\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.889841 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.889839 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-out\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890087 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.889875 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-main-db\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890087 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.889903 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-web\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890087 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.889927 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-web-config\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890087 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.889958 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-main-tls\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890087 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890003 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-volume\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890087 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890038 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-metrics-client-ca\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890087 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890084 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-tls-assets\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890453 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890110 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890453 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890169 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbf84\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-kube-api-access-gbf84\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890453 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890217 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-cluster-tls-config\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890453 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890251 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy\") pod \"4632f459-30ed-48cd-b9cb-5a05641f1e42\" (UID: \"4632f459-30ed-48cd-b9cb-5a05641f1e42\") " Jul 01 19:25:44.890453 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890242 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:44.890712 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890508 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.890712 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.890576 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:44.893027 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.892944 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-out" (OuterVolumeSpecName: "config-out") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:25:44.893027 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.892995 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:44.893461 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.893298 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:44.893461 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.893344 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-kube-api-access-gbf84" (OuterVolumeSpecName: "kube-api-access-gbf84") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "kube-api-access-gbf84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:44.893461 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.893409 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:44.893750 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.893717 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:44.893869 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.893792 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-volume" (OuterVolumeSpecName: "config-volume") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:44.894228 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.894205 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:44.895289 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.895263 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:44.898603 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.898578 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:44.905144 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.905117 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-web-config" (OuterVolumeSpecName: "web-config") pod "4632f459-30ed-48cd-b9cb-5a05641f1e42" (UID: "4632f459-30ed-48cd-b9cb-5a05641f1e42"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:44.991521 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991439 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991521 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991469 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-out\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991521 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991480 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4632f459-30ed-48cd-b9cb-5a05641f1e42-alertmanager-main-db\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991521 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991489 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991521 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991498 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-web-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991521 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991506 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-main-tls\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991521 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991514 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-config-volume\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991521 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991522 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4632f459-30ed-48cd-b9cb-5a05641f1e42-metrics-client-ca\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991841 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991530 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-tls-assets\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991841 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991538 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991841 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991547 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbf84\" (UniqueName: \"kubernetes.io/projected/4632f459-30ed-48cd-b9cb-5a05641f1e42-kube-api-access-gbf84\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:44.991841 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:44.991557 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4632f459-30ed-48cd-b9cb-5a05641f1e42-cluster-tls-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:25:45.220384 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.220340 2565 generic.go:356] "Generic (PLEG): container finished" podID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerID="d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023" exitCode=0 Jul 01 19:25:45.220384 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.220381 2565 generic.go:356] "Generic (PLEG): container finished" podID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerID="98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2" exitCode=0 Jul 01 19:25:45.220571 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.220405 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerDied","Data":"d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023"} Jul 01 19:25:45.220571 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.220429 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.220571 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.220479 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerDied","Data":"98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2"} Jul 01 19:25:45.220571 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.220510 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4632f459-30ed-48cd-b9cb-5a05641f1e42","Type":"ContainerDied","Data":"2b78e4d63f8c28fba3d93178ae605f0959426c65ec7b20c556c5ca707fce826b"} Jul 01 19:25:45.220571 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.220547 2565 scope.go:117] "RemoveContainer" containerID="42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49" Jul 01 19:25:45.228571 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.228554 2565 scope.go:117] "RemoveContainer" containerID="d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023" Jul 01 19:25:45.235438 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.235406 2565 scope.go:117] "RemoveContainer" containerID="f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66" Jul 01 19:25:45.242464 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.242445 2565 scope.go:117] "RemoveContainer" containerID="98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2" Jul 01 19:25:45.244612 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.244586 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:25:45.249646 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.249630 2565 scope.go:117] "RemoveContainer" containerID="514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e" Jul 01 19:25:45.257787 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.255683 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:25:45.259441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.259422 2565 scope.go:117] "RemoveContainer" containerID="b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd" Jul 01 19:25:45.267328 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.267298 2565 scope.go:117] "RemoveContainer" containerID="55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6" Jul 01 19:25:45.275841 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.275824 2565 scope.go:117] "RemoveContainer" containerID="42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49" Jul 01 19:25:45.276103 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:25:45.276082 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49\": container with ID starting with 42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49 not found: ID does not exist" containerID="42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49" Jul 01 19:25:45.276163 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.276110 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49"} err="failed to get container status \"42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49\": rpc error: code = NotFound desc = could not find container \"42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49\": container with ID starting with 42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49 not found: ID does not exist" Jul 01 19:25:45.276163 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.276129 2565 scope.go:117] "RemoveContainer" containerID="d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023" Jul 01 19:25:45.276394 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:25:45.276353 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023\": container with ID starting with d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023 not found: ID does not exist" containerID="d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023" Jul 01 19:25:45.276440 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.276401 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023"} err="failed to get container status \"d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023\": rpc error: code = NotFound desc = could not find container \"d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023\": container with ID starting with d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023 not found: ID does not exist" Jul 01 19:25:45.276440 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.276420 2565 scope.go:117] "RemoveContainer" containerID="f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66" Jul 01 19:25:45.276710 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:25:45.276694 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66\": container with ID starting with f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66 not found: ID does not exist" containerID="f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66" Jul 01 19:25:45.276751 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.276714 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66"} err="failed to get container status \"f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66\": rpc error: code = NotFound desc = could not find container \"f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66\": container with ID starting with f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66 not found: ID does not exist" Jul 01 19:25:45.276751 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.276727 2565 scope.go:117] "RemoveContainer" containerID="98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2" Jul 01 19:25:45.276962 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:25:45.276942 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2\": container with ID starting with 98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2 not found: ID does not exist" containerID="98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2" Jul 01 19:25:45.276962 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.276961 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2"} err="failed to get container status \"98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2\": rpc error: code = NotFound desc = could not find container \"98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2\": container with ID starting with 98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2 not found: ID does not exist" Jul 01 19:25:45.277128 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.276973 2565 scope.go:117] "RemoveContainer" containerID="514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e" Jul 01 19:25:45.277212 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:25:45.277194 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e\": container with ID starting with 514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e not found: ID does not exist" containerID="514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e" Jul 01 19:25:45.277268 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.277215 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e"} err="failed to get container status \"514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e\": rpc error: code = NotFound desc = could not find container \"514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e\": container with ID starting with 514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e not found: ID does not exist" Jul 01 19:25:45.277268 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.277230 2565 scope.go:117] "RemoveContainer" containerID="b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd" Jul 01 19:25:45.277764 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:25:45.277453 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd\": container with ID starting with b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd not found: ID does not exist" containerID="b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd" Jul 01 19:25:45.277764 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.277472 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd"} err="failed to get container status \"b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd\": rpc error: code = NotFound desc = could not find container \"b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd\": container with ID starting with b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd not found: ID does not exist" Jul 01 19:25:45.277764 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.277484 2565 scope.go:117] "RemoveContainer" containerID="55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6" Jul 01 19:25:45.277764 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:25:45.277700 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6\": container with ID starting with 55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6 not found: ID does not exist" containerID="55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6" Jul 01 19:25:45.277764 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.277723 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6"} err="failed to get container status \"55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6\": rpc error: code = NotFound desc = could not find container \"55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6\": container with ID starting with 55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6 not found: ID does not exist" Jul 01 19:25:45.277764 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.277736 2565 scope.go:117] "RemoveContainer" containerID="42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49" Jul 01 19:25:45.278104 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.277931 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49"} err="failed to get container status \"42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49\": rpc error: code = NotFound desc = could not find container \"42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49\": container with ID starting with 42b21af7500f84dc04718bb1536668d8a773123d9fec215a3614b4d0be653a49 not found: ID does not exist" Jul 01 19:25:45.278104 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.277948 2565 scope.go:117] "RemoveContainer" containerID="d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023" Jul 01 19:25:45.278300 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.278246 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023"} err="failed to get container status \"d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023\": rpc error: code = NotFound desc = could not find container \"d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023\": container with ID starting with d57d9e35e3beed8b5ff520b850f770fdcacee8b59e6adf088e9cb3ec562e8023 not found: ID does not exist" Jul 01 19:25:45.278300 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.278268 2565 scope.go:117] "RemoveContainer" containerID="f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66" Jul 01 19:25:45.279164 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.278765 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66"} err="failed to get container status \"f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66\": rpc error: code = NotFound desc = could not find container \"f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66\": container with ID starting with f266159fea679583f7802dfb4cea3a1136f8bfa2f56766b0600dcdfa6aa1bb66 not found: ID does not exist" Jul 01 19:25:45.279164 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.278790 2565 scope.go:117] "RemoveContainer" containerID="98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2" Jul 01 19:25:45.279164 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.279020 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2"} err="failed to get container status \"98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2\": rpc error: code = NotFound desc = could not find container \"98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2\": container with ID starting with 98655ace2935c8e1c500e049fb35d61cba64f93e1fd135aaae2f7e8c3d3556f2 not found: ID does not exist" Jul 01 19:25:45.279164 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.279041 2565 scope.go:117] "RemoveContainer" containerID="514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e" Jul 01 19:25:45.279402 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.279277 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e"} err="failed to get container status \"514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e\": rpc error: code = NotFound desc = could not find container \"514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e\": container with ID starting with 514109e0af8d03cbd8a2a17ff9d903f7bf6010fbdc506302aa494d186f20590e not found: ID does not exist" Jul 01 19:25:45.279402 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.279300 2565 scope.go:117] "RemoveContainer" containerID="b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd" Jul 01 19:25:45.279627 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.279582 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd"} err="failed to get container status \"b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd\": rpc error: code = NotFound desc = could not find container \"b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd\": container with ID starting with b58fe6a209aaae81d9a51c41567972b497661ad0b29ba495390f067cc478c9fd not found: ID does not exist" Jul 01 19:25:45.279668 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.279629 2565 scope.go:117] "RemoveContainer" containerID="55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6" Jul 01 19:25:45.279856 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.279837 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6"} err="failed to get container status \"55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6\": rpc error: code = NotFound desc = could not find container \"55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6\": container with ID starting with 55b66fac3a6102996cac4b2263bcddb619fd62adde32310a75202fce1d9029f6 not found: ID does not exist" Jul 01 19:25:45.281103 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281085 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:25:45.281568 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281553 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="init-config-reloader" Jul 01 19:25:45.281616 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281573 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="init-config-reloader" Jul 01 19:25:45.281616 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281591 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy" Jul 01 19:25:45.281616 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281600 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy" Jul 01 19:25:45.281717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281615 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69cfe07-399e-4cf2-bd39-54437038db7b" containerName="console" Jul 01 19:25:45.281717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281625 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69cfe07-399e-4cf2-bd39-54437038db7b" containerName="console" Jul 01 19:25:45.281717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281642 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy-metric" Jul 01 19:25:45.281717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281650 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy-metric" Jul 01 19:25:45.281717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281660 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="prom-label-proxy" Jul 01 19:25:45.281717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281669 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="prom-label-proxy" Jul 01 19:25:45.281717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281681 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy-web" Jul 01 19:25:45.281717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281696 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy-web" Jul 01 19:25:45.281717 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281714 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="alertmanager" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281722 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="alertmanager" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281731 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="config-reloader" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281739 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="config-reloader" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281812 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="config-reloader" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281825 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy-web" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281835 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="prom-label-proxy" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281847 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="alertmanager" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281856 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy-metric" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281866 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" containerName="kube-rbac-proxy" Jul 01 19:25:45.281967 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.281878 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69cfe07-399e-4cf2-bd39-54437038db7b" containerName="console" Jul 01 19:25:45.287994 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.286198 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.288921 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.288896 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 19:25:45.289030 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.288902 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 19:25:45.289158 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.289142 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 19:25:45.289236 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.289167 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 19:25:45.289293 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.289239 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 19:25:45.289293 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.289250 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 19:25:45.290275 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.290254 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 19:25:45.290353 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.290346 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6vc7v\"" Jul 01 19:25:45.290741 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.290727 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 19:25:45.295085 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.295066 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 19:25:45.299754 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.299729 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:25:45.395179 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f381d44e-3c12-447e-9c05-837eef5f6778-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395179 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n46w8\" (UniqueName: \"kubernetes.io/projected/f381d44e-3c12-447e-9c05-837eef5f6778-kube-api-access-n46w8\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f381d44e-3c12-447e-9c05-837eef5f6778-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f381d44e-3c12-447e-9c05-837eef5f6778-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-config-volume\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-web-config\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395441 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395701 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f381d44e-3c12-447e-9c05-837eef5f6778-config-out\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395701 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395488 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f381d44e-3c12-447e-9c05-837eef5f6778-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.395701 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.395513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.408859 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.408831 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4632f459-30ed-48cd-b9cb-5a05641f1e42" path="/var/lib/kubelet/pods/4632f459-30ed-48cd-b9cb-5a05641f1e42/volumes" Jul 01 19:25:45.496764 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.496741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.496884 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.496775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-web-config\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.496884 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.496813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.496993 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.496962 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f381d44e-3c12-447e-9c05-837eef5f6778-config-out\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.497042 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.497022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f381d44e-3c12-447e-9c05-837eef5f6778-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.497086 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.497061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.497134 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.497098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f381d44e-3c12-447e-9c05-837eef5f6778-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.497134 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.497124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n46w8\" (UniqueName: \"kubernetes.io/projected/f381d44e-3c12-447e-9c05-837eef5f6778-kube-api-access-n46w8\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.497236 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.497162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f381d44e-3c12-447e-9c05-837eef5f6778-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.497236 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.497185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f381d44e-3c12-447e-9c05-837eef5f6778-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.497236 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.497221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.497415 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.497250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.497415 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.497281 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-config-volume\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.498396 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.498057 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f381d44e-3c12-447e-9c05-837eef5f6778-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.498396 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.498191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f381d44e-3c12-447e-9c05-837eef5f6778-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.500007 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.499976 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.500119 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.500048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-web-config\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.500343 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.500262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.500948 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.500356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.500948 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.500715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f381d44e-3c12-447e-9c05-837eef5f6778-config-out\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.500948 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.500819 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f381d44e-3c12-447e-9c05-837eef5f6778-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.500948 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.500880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-config-volume\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.500948 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.500914 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.501210 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.501040 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f381d44e-3c12-447e-9c05-837eef5f6778-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.502173 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.502152 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f381d44e-3c12-447e-9c05-837eef5f6778-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.510224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.510191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n46w8\" (UniqueName: \"kubernetes.io/projected/f381d44e-3c12-447e-9c05-837eef5f6778-kube-api-access-n46w8\") pod \"alertmanager-main-0\" (UID: \"f381d44e-3c12-447e-9c05-837eef5f6778\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.598689 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.598637 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:25:45.748267 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:45.748196 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:25:45.753779 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:25:45.753752 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf381d44e_3c12_447e_9c05_837eef5f6778.slice/crio-df2c9968cecc7986f3723a7b702dbc4035ed676f9a99309831cf02d87812a42e WatchSource:0}: Error finding container df2c9968cecc7986f3723a7b702dbc4035ed676f9a99309831cf02d87812a42e: Status 404 returned error can't find the container with id df2c9968cecc7986f3723a7b702dbc4035ed676f9a99309831cf02d87812a42e Jul 01 19:25:46.226158 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:46.226076 2565 generic.go:356] "Generic (PLEG): container finished" podID="f381d44e-3c12-447e-9c05-837eef5f6778" containerID="f7aa2008a3c33683ae35e8192f2ded1947ea249d7b4dc6b20ab1723d7498dba8" exitCode=0 Jul 01 19:25:46.226158 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:46.226115 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f381d44e-3c12-447e-9c05-837eef5f6778","Type":"ContainerDied","Data":"f7aa2008a3c33683ae35e8192f2ded1947ea249d7b4dc6b20ab1723d7498dba8"} Jul 01 19:25:46.226592 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:46.226163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f381d44e-3c12-447e-9c05-837eef5f6778","Type":"ContainerStarted","Data":"df2c9968cecc7986f3723a7b702dbc4035ed676f9a99309831cf02d87812a42e"} Jul 01 19:25:47.233989 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.233949 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f381d44e-3c12-447e-9c05-837eef5f6778","Type":"ContainerStarted","Data":"0762cee126dcb11791b903acc4a01bfd81b28a71040a14a0287103541819c7bd"} Jul 01 19:25:47.234494 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.234068 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f381d44e-3c12-447e-9c05-837eef5f6778","Type":"ContainerStarted","Data":"a801f32b7bb1b1d85fdf18251ef00b1fe39a806cbb1438e8ec2ea8779d538af3"} Jul 01 19:25:47.234494 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.234115 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f381d44e-3c12-447e-9c05-837eef5f6778","Type":"ContainerStarted","Data":"ad01f55ca20715adedda32a4981cf12638bf09c056470a97c7897cf2cb8d7bd5"} Jul 01 19:25:47.234494 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.234162 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f381d44e-3c12-447e-9c05-837eef5f6778","Type":"ContainerStarted","Data":"f7c43cec42dc42c1cec896e0cf8f0b02b5043fab3dcd74a3e69b884eb2593b42"} Jul 01 19:25:47.234494 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.234199 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f381d44e-3c12-447e-9c05-837eef5f6778","Type":"ContainerStarted","Data":"3472eec984bbd40e30ecd8135ae64d419adcce91ecf7beef8f33678ed32f15a6"} Jul 01 19:25:47.234494 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.234247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f381d44e-3c12-447e-9c05-837eef5f6778","Type":"ContainerStarted","Data":"f7af775703519fa13a6870c8721573cb3239da1ca12eb460eee2bb8f1bd8c66e"} Jul 01 19:25:47.282041 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.281987 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.2658706889999998 podStartE2EDuration="2.281968362s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.097673ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:47.281073735 +0000 UTC m=+192.367809621" watchObservedRunningTime="2026-07-01 19:25:47.281968362 +0000 UTC m=+192.368704221" Jul 01 19:25:47.440053 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.440014 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6777d747b9-ln8cc"] Jul 01 19:25:47.443641 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.443615 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.446873 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.446088 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 19:25:47.446873 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.446808 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 19:25:47.447579 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.447559 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5nhzz\"" Jul 01 19:25:47.447714 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.447593 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 19:25:47.447795 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.447719 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 19:25:47.447858 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.447847 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 19:25:47.454006 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.453794 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 19:25:47.459251 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.459231 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6777d747b9-ln8cc"] Jul 01 19:25:47.517747 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.517715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-telemeter-client-tls\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.517926 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.517756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm4kq\" (UniqueName: \"kubernetes.io/projected/5e8cf33d-81aa-479e-87ad-94b9712689ab-kube-api-access-nm4kq\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.518014 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.517921 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8cf33d-81aa-479e-87ad-94b9712689ab-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.518014 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.517968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e8cf33d-81aa-479e-87ad-94b9712689ab-metrics-client-ca\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.518103 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.518054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8cf33d-81aa-479e-87ad-94b9712689ab-serving-certs-ca-bundle\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.518142 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.518099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.518142 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.518135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-secret-telemeter-client\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.518237 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.518149 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-federate-client-tls\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.619713 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.619667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-telemeter-client-tls\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.619713 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.619720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm4kq\" (UniqueName: \"kubernetes.io/projected/5e8cf33d-81aa-479e-87ad-94b9712689ab-kube-api-access-nm4kq\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.619976 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.619768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8cf33d-81aa-479e-87ad-94b9712689ab-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.619976 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.619792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e8cf33d-81aa-479e-87ad-94b9712689ab-metrics-client-ca\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.619976 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.619830 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8cf33d-81aa-479e-87ad-94b9712689ab-serving-certs-ca-bundle\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.619976 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.619859 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.619976 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.619894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-secret-telemeter-client\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.620561 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.620529 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-federate-client-tls\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.620871 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.620747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8cf33d-81aa-479e-87ad-94b9712689ab-serving-certs-ca-bundle\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.620871 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.620843 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8cf33d-81aa-479e-87ad-94b9712689ab-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.621810 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.621779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e8cf33d-81aa-479e-87ad-94b9712689ab-metrics-client-ca\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.623055 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.623023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-federate-client-tls\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.623210 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.623184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.623273 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.623226 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-secret-telemeter-client\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.623316 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.623280 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5e8cf33d-81aa-479e-87ad-94b9712689ab-telemeter-client-tls\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.630578 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.630555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm4kq\" (UniqueName: \"kubernetes.io/projected/5e8cf33d-81aa-479e-87ad-94b9712689ab-kube-api-access-nm4kq\") pod \"telemeter-client-6777d747b9-ln8cc\" (UID: \"5e8cf33d-81aa-479e-87ad-94b9712689ab\") " pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.755570 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.755535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" Jul 01 19:25:47.918800 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:47.918770 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6777d747b9-ln8cc"] Jul 01 19:25:47.923731 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:25:47.923690 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8cf33d_81aa_479e_87ad_94b9712689ab.slice/crio-09e0ea0f9921918c90fab0325d914e689f8b258bb6847eae81dbdb6911d34dd5 WatchSource:0}: Error finding container 09e0ea0f9921918c90fab0325d914e689f8b258bb6847eae81dbdb6911d34dd5: Status 404 returned error can't find the container with id 09e0ea0f9921918c90fab0325d914e689f8b258bb6847eae81dbdb6911d34dd5 Jul 01 19:25:48.239994 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:48.239901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" event={"ID":"5e8cf33d-81aa-479e-87ad-94b9712689ab","Type":"ContainerStarted","Data":"09e0ea0f9921918c90fab0325d914e689f8b258bb6847eae81dbdb6911d34dd5"} Jul 01 19:25:51.255273 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:51.255228 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" event={"ID":"5e8cf33d-81aa-479e-87ad-94b9712689ab","Type":"ContainerStarted","Data":"1cdbd09b2eff8738c075cb3f57bdfadc7fbce1076d2bf41e2f8eca9b6d44ac24"} Jul 01 19:25:51.255660 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:51.255314 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" event={"ID":"5e8cf33d-81aa-479e-87ad-94b9712689ab","Type":"ContainerStarted","Data":"715fd95263c2c7f6412359a29607f70190c5ef407d20539ed99f2235f9a7318a"} Jul 01 19:25:51.255660 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:51.255333 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" event={"ID":"5e8cf33d-81aa-479e-87ad-94b9712689ab","Type":"ContainerStarted","Data":"c20eb708c6f5f2add98d477518954f735eae37a7bb62e89c790b8f2ee9bbac44"} Jul 01 19:25:51.282137 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:51.282088 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6777d747b9-ln8cc" podStartSLOduration=1.591905649 podStartE2EDuration="4.282070806s" totalImagesPullingTime="2.690165157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:51.280167664 +0000 UTC m=+196.366903524" watchObservedRunningTime="2026-07-01 19:25:51.282070806 +0000 UTC m=+196.368806673" Jul 01 19:25:52.174428 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.174393 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c79888f86-rcxcg"] Jul 01 19:25:52.177798 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.177779 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.194935 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.194909 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c79888f86-rcxcg"] Jul 01 19:25:52.265540 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.265513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-config\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.265905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.265554 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-serving-cert\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.265905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.265574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-oauth-config\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.265905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.265591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-oauth-serving-cert\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.265905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.265623 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-service-ca\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.265905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.265642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8cds\" (UniqueName: \"kubernetes.io/projected/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-kube-api-access-g8cds\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.265905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.265676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-trusted-ca-bundle\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.367033 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.366999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-config\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.367223 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.367046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-serving-cert\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.367223 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.367073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-oauth-config\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.367223 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.367103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-oauth-serving-cert\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.367223 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.367178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-service-ca\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.367223 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.367213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8cds\" (UniqueName: \"kubernetes.io/projected/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-kube-api-access-g8cds\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.367512 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.367265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-trusted-ca-bundle\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.368003 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.367976 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-config\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.368150 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.368125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-oauth-serving-cert\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.368465 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.368438 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-service-ca\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.368689 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.368671 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-trusted-ca-bundle\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.369656 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.369633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-oauth-config\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.369768 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.369745 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-serving-cert\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.375345 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.375324 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8cds\" (UniqueName: \"kubernetes.io/projected/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-kube-api-access-g8cds\") pod \"console-5c79888f86-rcxcg\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.487228 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.487134 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:25:52.633115 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:52.633082 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c79888f86-rcxcg"] Jul 01 19:25:52.636274 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:25:52.636249 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f400e4e_ab78_43dd_9f13_65f53e9d7afb.slice/crio-5a24f0fcaea630a6bdfd8790f1050f9a8117a463e63e7948d5d38cf712836dc4 WatchSource:0}: Error finding container 5a24f0fcaea630a6bdfd8790f1050f9a8117a463e63e7948d5d38cf712836dc4: Status 404 returned error can't find the container with id 5a24f0fcaea630a6bdfd8790f1050f9a8117a463e63e7948d5d38cf712836dc4 Jul 01 19:25:53.264225 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:53.264189 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c79888f86-rcxcg" event={"ID":"9f400e4e-ab78-43dd-9f13-65f53e9d7afb","Type":"ContainerStarted","Data":"fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27"} Jul 01 19:25:53.264439 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:53.264245 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c79888f86-rcxcg" event={"ID":"9f400e4e-ab78-43dd-9f13-65f53e9d7afb","Type":"ContainerStarted","Data":"5a24f0fcaea630a6bdfd8790f1050f9a8117a463e63e7948d5d38cf712836dc4"} Jul 01 19:25:53.283045 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:25:53.282996 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c79888f86-rcxcg" podStartSLOduration=1.282980594 podStartE2EDuration="1.282980594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:53.282222958 +0000 UTC m=+198.368958820" watchObservedRunningTime="2026-07-01 19:25:53.282980594 +0000 UTC m=+198.369716453" Jul 01 19:26:02.487415 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:02.487355 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:26:02.487912 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:02.487444 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:26:02.492285 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:02.492263 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:26:03.308191 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:03.308166 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:26:03.368224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:03.368190 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c5b5bf79-s5vq8"] Jul 01 19:26:28.389552 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.389488 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69c5b5bf79-s5vq8" podUID="8619d8a9-08a2-4886-aa09-0cf6f4003617" containerName="console" containerID="cri-o://bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4" gracePeriod=15 Jul 01 19:26:28.639639 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.639588 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:26:28.780953 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.780906 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-serving-cert\") pod \"8619d8a9-08a2-4886-aa09-0cf6f4003617\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " Jul 01 19:26:28.780953 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.780960 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-service-ca\") pod \"8619d8a9-08a2-4886-aa09-0cf6f4003617\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " Jul 01 19:26:28.781204 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.780990 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-oauth-serving-cert\") pod \"8619d8a9-08a2-4886-aa09-0cf6f4003617\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " Jul 01 19:26:28.781204 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781044 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-trusted-ca-bundle\") pod \"8619d8a9-08a2-4886-aa09-0cf6f4003617\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " Jul 01 19:26:28.781204 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781083 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-545mh\" (UniqueName: \"kubernetes.io/projected/8619d8a9-08a2-4886-aa09-0cf6f4003617-kube-api-access-545mh\") pod \"8619d8a9-08a2-4886-aa09-0cf6f4003617\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " Jul 01 19:26:28.781204 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781106 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-oauth-config\") pod \"8619d8a9-08a2-4886-aa09-0cf6f4003617\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " Jul 01 19:26:28.781204 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781175 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-config\") pod \"8619d8a9-08a2-4886-aa09-0cf6f4003617\" (UID: \"8619d8a9-08a2-4886-aa09-0cf6f4003617\") " Jul 01 19:26:28.781483 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781442 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8619d8a9-08a2-4886-aa09-0cf6f4003617" (UID: "8619d8a9-08a2-4886-aa09-0cf6f4003617"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:28.781483 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781462 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-service-ca" (OuterVolumeSpecName: "service-ca") pod "8619d8a9-08a2-4886-aa09-0cf6f4003617" (UID: "8619d8a9-08a2-4886-aa09-0cf6f4003617"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:28.781609 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781511 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8619d8a9-08a2-4886-aa09-0cf6f4003617" (UID: "8619d8a9-08a2-4886-aa09-0cf6f4003617"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:28.781609 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781567 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-service-ca\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:26:28.781609 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781586 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-oauth-serving-cert\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:26:28.781782 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.781759 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-config" (OuterVolumeSpecName: "console-config") pod "8619d8a9-08a2-4886-aa09-0cf6f4003617" (UID: "8619d8a9-08a2-4886-aa09-0cf6f4003617"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:28.783218 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.783193 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8619d8a9-08a2-4886-aa09-0cf6f4003617" (UID: "8619d8a9-08a2-4886-aa09-0cf6f4003617"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:28.783326 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.783249 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8619d8a9-08a2-4886-aa09-0cf6f4003617" (UID: "8619d8a9-08a2-4886-aa09-0cf6f4003617"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:28.783494 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.783474 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8619d8a9-08a2-4886-aa09-0cf6f4003617-kube-api-access-545mh" (OuterVolumeSpecName: "kube-api-access-545mh") pod "8619d8a9-08a2-4886-aa09-0cf6f4003617" (UID: "8619d8a9-08a2-4886-aa09-0cf6f4003617"). InnerVolumeSpecName "kube-api-access-545mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:28.882038 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.882004 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-oauth-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:26:28.882038 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.882030 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:26:28.882038 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.882040 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8619d8a9-08a2-4886-aa09-0cf6f4003617-console-serving-cert\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:26:28.882266 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.882049 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8619d8a9-08a2-4886-aa09-0cf6f4003617-trusted-ca-bundle\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:26:28.882266 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:28.882059 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-545mh\" (UniqueName: \"kubernetes.io/projected/8619d8a9-08a2-4886-aa09-0cf6f4003617-kube-api-access-545mh\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:26:29.409850 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:29.409818 2565 generic.go:356] "Generic (PLEG): container finished" podID="8619d8a9-08a2-4886-aa09-0cf6f4003617" containerID="bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4" exitCode=0 Jul 01 19:26:29.410271 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:29.409866 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5b5bf79-s5vq8" Jul 01 19:26:29.410271 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:29.409901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5b5bf79-s5vq8" event={"ID":"8619d8a9-08a2-4886-aa09-0cf6f4003617","Type":"ContainerDied","Data":"bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4"} Jul 01 19:26:29.410271 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:29.409954 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5b5bf79-s5vq8" event={"ID":"8619d8a9-08a2-4886-aa09-0cf6f4003617","Type":"ContainerDied","Data":"06ff0afdbf4f0a2eac2221232fc36c2e0352cdd42e66d3acce8e27d32d1bd679"} Jul 01 19:26:29.410271 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:29.409980 2565 scope.go:117] "RemoveContainer" containerID="bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4" Jul 01 19:26:29.425712 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:29.425683 2565 scope.go:117] "RemoveContainer" containerID="bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4" Jul 01 19:26:29.425956 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:26:29.425937 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4\": container with ID starting with bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4 not found: ID does not exist" containerID="bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4" Jul 01 19:26:29.426022 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:29.425965 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4"} err="failed to get container status \"bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4\": rpc error: code = NotFound desc = could not find container \"bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4\": container with ID starting with bc1cc8bb86086f985e996e2e682814e5f8fc88cf9ed5b01ab0d84220710622e4 not found: ID does not exist" Jul 01 19:26:29.438951 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:29.438910 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c5b5bf79-s5vq8"] Jul 01 19:26:29.440201 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:29.440182 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69c5b5bf79-s5vq8"] Jul 01 19:26:31.409117 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:31.409083 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8619d8a9-08a2-4886-aa09-0cf6f4003617" path="/var/lib/kubelet/pods/8619d8a9-08a2-4886-aa09-0cf6f4003617/volumes" Jul 01 19:26:59.525572 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.525485 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8f579b49-sgxtc"] Jul 01 19:26:59.526006 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.525846 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8619d8a9-08a2-4886-aa09-0cf6f4003617" containerName="console" Jul 01 19:26:59.526006 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.525861 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8619d8a9-08a2-4886-aa09-0cf6f4003617" containerName="console" Jul 01 19:26:59.526006 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.525923 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8619d8a9-08a2-4886-aa09-0cf6f4003617" containerName="console" Jul 01 19:26:59.528831 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.528811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.544906 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.544882 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f579b49-sgxtc"] Jul 01 19:26:59.633918 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.633889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-service-ca\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.634051 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.633921 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-oauth-serving-cert\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.634051 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.633951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-config\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.634051 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.633966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-trusted-ca-bundle\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.634157 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.634051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-serving-cert\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.634157 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.634094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9vt6\" (UniqueName: \"kubernetes.io/projected/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-kube-api-access-x9vt6\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.634157 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.634119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-oauth-config\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.734598 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.734564 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-oauth-config\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.734735 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.734619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-service-ca\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.734735 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.734651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-oauth-serving-cert\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.734735 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.734698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-config\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.734911 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.734890 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-trusted-ca-bundle\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.734971 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.734935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-serving-cert\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.734971 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.734956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9vt6\" (UniqueName: \"kubernetes.io/projected/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-kube-api-access-x9vt6\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.735510 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.735485 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-oauth-serving-cert\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.735652 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.735636 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-config\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.735862 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.735835 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-service-ca\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.735993 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.735948 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-trusted-ca-bundle\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.737132 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.737109 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-oauth-config\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.737284 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.737263 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-serving-cert\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.744618 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.744595 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9vt6\" (UniqueName: \"kubernetes.io/projected/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-kube-api-access-x9vt6\") pod \"console-8f579b49-sgxtc\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.838179 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.838125 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:26:59.974753 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:26:59.974722 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f579b49-sgxtc"] Jul 01 19:26:59.977711 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:26:59.977689 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca27ff5_31a1_47ad_a7ea_afb666a72c93.slice/crio-e9bcb472130351bc319be934bb888eae7cf8ab3a42f66aa2a31f1db0c3da208e WatchSource:0}: Error finding container e9bcb472130351bc319be934bb888eae7cf8ab3a42f66aa2a31f1db0c3da208e: Status 404 returned error can't find the container with id e9bcb472130351bc319be934bb888eae7cf8ab3a42f66aa2a31f1db0c3da208e Jul 01 19:27:00.532584 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:00.532552 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f579b49-sgxtc" event={"ID":"9ca27ff5-31a1-47ad-a7ea-afb666a72c93","Type":"ContainerStarted","Data":"80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac"} Jul 01 19:27:00.532956 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:00.532601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f579b49-sgxtc" event={"ID":"9ca27ff5-31a1-47ad-a7ea-afb666a72c93","Type":"ContainerStarted","Data":"e9bcb472130351bc319be934bb888eae7cf8ab3a42f66aa2a31f1db0c3da208e"} Jul 01 19:27:00.556136 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:00.556089 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8f579b49-sgxtc" podStartSLOduration=1.5560703340000002 podStartE2EDuration="1.556070334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:00.555103895 +0000 UTC m=+265.641839757" watchObservedRunningTime="2026-07-01 19:27:00.556070334 +0000 UTC m=+265.642806195" Jul 01 19:27:09.839090 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:09.839050 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:27:09.839575 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:09.839112 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:27:09.843902 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:09.843884 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:27:10.577952 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:10.577926 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:27:10.646482 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:10.646448 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c79888f86-rcxcg"] Jul 01 19:27:35.349489 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:35.349465 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:27:35.674576 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:35.674480 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c79888f86-rcxcg" podUID="9f400e4e-ab78-43dd-9f13-65f53e9d7afb" containerName="console" containerID="cri-o://fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27" gracePeriod=15 Jul 01 19:27:35.918978 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:35.918955 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:27:36.029028 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029000 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-serving-cert\") pod \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " Jul 01 19:27:36.029186 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029044 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-trusted-ca-bundle\") pod \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " Jul 01 19:27:36.029186 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029084 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8cds\" (UniqueName: \"kubernetes.io/projected/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-kube-api-access-g8cds\") pod \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " Jul 01 19:27:36.029296 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029258 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-oauth-config\") pod \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " Jul 01 19:27:36.029349 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029322 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-oauth-serving-cert\") pod \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " Jul 01 19:27:36.029434 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029396 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-service-ca\") pod \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " Jul 01 19:27:36.029434 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029427 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-config\") pod \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\" (UID: \"9f400e4e-ab78-43dd-9f13-65f53e9d7afb\") " Jul 01 19:27:36.029536 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029461 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9f400e4e-ab78-43dd-9f13-65f53e9d7afb" (UID: "9f400e4e-ab78-43dd-9f13-65f53e9d7afb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:27:36.029675 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029659 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-trusted-ca-bundle\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:27:36.029761 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029671 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9f400e4e-ab78-43dd-9f13-65f53e9d7afb" (UID: "9f400e4e-ab78-43dd-9f13-65f53e9d7afb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:27:36.029815 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029764 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-service-ca" (OuterVolumeSpecName: "service-ca") pod "9f400e4e-ab78-43dd-9f13-65f53e9d7afb" (UID: "9f400e4e-ab78-43dd-9f13-65f53e9d7afb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:27:36.029868 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.029846 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-config" (OuterVolumeSpecName: "console-config") pod "9f400e4e-ab78-43dd-9f13-65f53e9d7afb" (UID: "9f400e4e-ab78-43dd-9f13-65f53e9d7afb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:27:36.031539 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.031514 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-kube-api-access-g8cds" (OuterVolumeSpecName: "kube-api-access-g8cds") pod "9f400e4e-ab78-43dd-9f13-65f53e9d7afb" (UID: "9f400e4e-ab78-43dd-9f13-65f53e9d7afb"). InnerVolumeSpecName "kube-api-access-g8cds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:27:36.031539 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.031516 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9f400e4e-ab78-43dd-9f13-65f53e9d7afb" (UID: "9f400e4e-ab78-43dd-9f13-65f53e9d7afb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:27:36.031689 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.031556 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9f400e4e-ab78-43dd-9f13-65f53e9d7afb" (UID: "9f400e4e-ab78-43dd-9f13-65f53e9d7afb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:27:36.130052 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.130017 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-serving-cert\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:27:36.130052 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.130060 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8cds\" (UniqueName: \"kubernetes.io/projected/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-kube-api-access-g8cds\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:27:36.130255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.130074 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-oauth-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:27:36.130255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.130085 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-oauth-serving-cert\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:27:36.130255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.130097 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-service-ca\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:27:36.130255 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.130107 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f400e4e-ab78-43dd-9f13-65f53e9d7afb-console-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:27:36.677750 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.677719 2565 generic.go:356] "Generic (PLEG): container finished" podID="9f400e4e-ab78-43dd-9f13-65f53e9d7afb" containerID="fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27" exitCode=0 Jul 01 19:27:36.678151 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.677763 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c79888f86-rcxcg" Jul 01 19:27:36.678151 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.677765 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c79888f86-rcxcg" event={"ID":"9f400e4e-ab78-43dd-9f13-65f53e9d7afb","Type":"ContainerDied","Data":"fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27"} Jul 01 19:27:36.678151 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.677868 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c79888f86-rcxcg" event={"ID":"9f400e4e-ab78-43dd-9f13-65f53e9d7afb","Type":"ContainerDied","Data":"5a24f0fcaea630a6bdfd8790f1050f9a8117a463e63e7948d5d38cf712836dc4"} Jul 01 19:27:36.678151 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.677887 2565 scope.go:117] "RemoveContainer" containerID="fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27" Jul 01 19:27:36.686567 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.686550 2565 scope.go:117] "RemoveContainer" containerID="fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27" Jul 01 19:27:36.686791 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:27:36.686774 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27\": container with ID starting with fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27 not found: ID does not exist" containerID="fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27" Jul 01 19:27:36.686842 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.686800 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27"} err="failed to get container status \"fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27\": rpc error: code = NotFound desc = could not find container \"fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27\": container with ID starting with fda22384778d88ec644279edef7f14d83a657cb21fa87bd616ad401cd3770c27 not found: ID does not exist" Jul 01 19:27:36.703890 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.703866 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c79888f86-rcxcg"] Jul 01 19:27:36.710545 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:36.710522 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c79888f86-rcxcg"] Jul 01 19:27:37.409145 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:27:37.409107 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f400e4e-ab78-43dd-9f13-65f53e9d7afb" path="/var/lib/kubelet/pods/9f400e4e-ab78-43dd-9f13-65f53e9d7afb/volumes" Jul 01 19:28:31.537110 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.537022 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8"] Jul 01 19:28:31.537649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.537436 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f400e4e-ab78-43dd-9f13-65f53e9d7afb" containerName="console" Jul 01 19:28:31.537649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.537456 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f400e4e-ab78-43dd-9f13-65f53e9d7afb" containerName="console" Jul 01 19:28:31.537649 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.537545 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f400e4e-ab78-43dd-9f13-65f53e9d7afb" containerName="console" Jul 01 19:28:31.540429 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.540412 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:28:31.543611 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.543588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 01 19:28:31.543733 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.543619 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 01 19:28:31.543733 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.543627 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-nl282\"" Jul 01 19:28:31.543980 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.543966 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 01 19:28:31.560731 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.560702 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8"] Jul 01 19:28:31.670749 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.670718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ee2d8eb7-b656-4b4d-9bd3-5236faa83c00-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8\" (UID: \"ee2d8eb7-b656-4b4d-9bd3-5236faa83c00\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:28:31.670914 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.670780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcqls\" (UniqueName: \"kubernetes.io/projected/ee2d8eb7-b656-4b4d-9bd3-5236faa83c00-kube-api-access-bcqls\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8\" (UID: \"ee2d8eb7-b656-4b4d-9bd3-5236faa83c00\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:28:31.771241 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.771207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcqls\" (UniqueName: \"kubernetes.io/projected/ee2d8eb7-b656-4b4d-9bd3-5236faa83c00-kube-api-access-bcqls\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8\" (UID: \"ee2d8eb7-b656-4b4d-9bd3-5236faa83c00\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:28:31.771426 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.771265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ee2d8eb7-b656-4b4d-9bd3-5236faa83c00-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8\" (UID: \"ee2d8eb7-b656-4b4d-9bd3-5236faa83c00\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:28:31.773663 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.773642 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ee2d8eb7-b656-4b4d-9bd3-5236faa83c00-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8\" (UID: \"ee2d8eb7-b656-4b4d-9bd3-5236faa83c00\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:28:31.780554 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.780535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcqls\" (UniqueName: \"kubernetes.io/projected/ee2d8eb7-b656-4b4d-9bd3-5236faa83c00-kube-api-access-bcqls\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8\" (UID: \"ee2d8eb7-b656-4b4d-9bd3-5236faa83c00\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:28:31.852621 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.852560 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:28:31.999636 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:31.999605 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8"] Jul 01 19:28:32.003332 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:28:32.003306 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2d8eb7_b656_4b4d_9bd3_5236faa83c00.slice/crio-397c0b79785d68534d707504c8e1a5c20374d5fb1f8ce61a16adae5d0fbd8b6b WatchSource:0}: Error finding container 397c0b79785d68534d707504c8e1a5c20374d5fb1f8ce61a16adae5d0fbd8b6b: Status 404 returned error can't find the container with id 397c0b79785d68534d707504c8e1a5c20374d5fb1f8ce61a16adae5d0fbd8b6b Jul 01 19:28:32.005605 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:32.005589 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:28:32.896542 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:32.896501 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" event={"ID":"ee2d8eb7-b656-4b4d-9bd3-5236faa83c00","Type":"ContainerStarted","Data":"397c0b79785d68534d707504c8e1a5c20374d5fb1f8ce61a16adae5d0fbd8b6b"} Jul 01 19:28:35.913544 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:35.913500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" event={"ID":"ee2d8eb7-b656-4b4d-9bd3-5236faa83c00","Type":"ContainerStarted","Data":"92cb9106be679f0d8e66eaa8a623dbd59cc03dc2209bfa3c21d6684630f6fbde"} Jul 01 19:28:35.913981 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:35.913679 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:28:35.938014 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:35.937958 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" podStartSLOduration=1.630987341 podStartE2EDuration="4.937938548s" totalImagesPullingTime="3.306951207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:28:35.935439786 +0000 UTC m=+361.022175648" watchObservedRunningTime="2026-07-01 19:28:35.937938548 +0000 UTC m=+361.024674412" Jul 01 19:28:56.919412 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:28:56.919355 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-5vcb8" Jul 01 19:29:43.745241 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.745206 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-79d94fb575-d4mz5"] Jul 01 19:29:43.747420 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.747405 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:29:43.751961 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.751940 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 01 19:29:43.752350 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.752334 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 19:29:43.752943 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.752920 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-zdzqz"] Jul 01 19:29:43.753162 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.753144 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 19:29:43.753224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.753202 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-tx9tr\"" Jul 01 19:29:43.756191 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.756159 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:43.759278 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.759258 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 01 19:29:43.759542 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.759527 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-b7tdz\"" Jul 01 19:29:43.772646 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.772625 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-79d94fb575-d4mz5"] Jul 01 19:29:43.800266 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.800241 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-zdzqz"] Jul 01 19:29:43.802805 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.802778 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-dwwpp"] Jul 01 19:29:43.805790 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.805771 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:29:43.808033 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.808017 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 19:29:43.808184 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.808028 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zqwb7\"" Jul 01 19:29:43.811309 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.811290 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-dwwpp"] Jul 01 19:29:43.828225 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.828202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/587a610a-fefb-4eec-b008-e89f1c5a79a5-cert\") pod \"llmisvc-controller-manager-67d95fdc48-zdzqz\" (UID: \"587a610a-fefb-4eec-b008-e89f1c5a79a5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:43.828337 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.828283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcn47\" (UniqueName: \"kubernetes.io/projected/354098ff-6784-45e5-9ff6-92ec0a390582-kube-api-access-qcn47\") pod \"kserve-controller-manager-79d94fb575-d4mz5\" (UID: \"354098ff-6784-45e5-9ff6-92ec0a390582\") " pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:29:43.828337 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.828319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354098ff-6784-45e5-9ff6-92ec0a390582-cert\") pod \"kserve-controller-manager-79d94fb575-d4mz5\" (UID: \"354098ff-6784-45e5-9ff6-92ec0a390582\") " pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:29:43.828444 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.828374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dmjz\" (UniqueName: \"kubernetes.io/projected/587a610a-fefb-4eec-b008-e89f1c5a79a5-kube-api-access-7dmjz\") pod \"llmisvc-controller-manager-67d95fdc48-zdzqz\" (UID: \"587a610a-fefb-4eec-b008-e89f1c5a79a5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:43.929286 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.929255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7nmt\" (UniqueName: \"kubernetes.io/projected/dffe5c4d-0cde-44e1-8356-7ef992d85e1a-kube-api-access-x7nmt\") pod \"seaweedfs-64568bcd49-dwwpp\" (UID: \"dffe5c4d-0cde-44e1-8356-7ef992d85e1a\") " pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:29:43.929286 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.929293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354098ff-6784-45e5-9ff6-92ec0a390582-cert\") pod \"kserve-controller-manager-79d94fb575-d4mz5\" (UID: \"354098ff-6784-45e5-9ff6-92ec0a390582\") " pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:29:43.929535 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.929317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dmjz\" (UniqueName: \"kubernetes.io/projected/587a610a-fefb-4eec-b008-e89f1c5a79a5-kube-api-access-7dmjz\") pod \"llmisvc-controller-manager-67d95fdc48-zdzqz\" (UID: \"587a610a-fefb-4eec-b008-e89f1c5a79a5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:43.929535 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.929433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/587a610a-fefb-4eec-b008-e89f1c5a79a5-cert\") pod \"llmisvc-controller-manager-67d95fdc48-zdzqz\" (UID: \"587a610a-fefb-4eec-b008-e89f1c5a79a5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:43.929535 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.929521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcn47\" (UniqueName: \"kubernetes.io/projected/354098ff-6784-45e5-9ff6-92ec0a390582-kube-api-access-qcn47\") pod \"kserve-controller-manager-79d94fb575-d4mz5\" (UID: \"354098ff-6784-45e5-9ff6-92ec0a390582\") " pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:29:43.929680 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:29:43.929557 2565 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 19:29:43.929680 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.929562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dffe5c4d-0cde-44e1-8356-7ef992d85e1a-data\") pod \"seaweedfs-64568bcd49-dwwpp\" (UID: \"dffe5c4d-0cde-44e1-8356-7ef992d85e1a\") " pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:29:43.929680 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:29:43.929630 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/587a610a-fefb-4eec-b008-e89f1c5a79a5-cert podName:587a610a-fefb-4eec-b008-e89f1c5a79a5 nodeName:}" failed. No retries permitted until 2026-07-01 19:29:44.429610126 +0000 UTC m=+429.516345964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/587a610a-fefb-4eec-b008-e89f1c5a79a5-cert") pod "llmisvc-controller-manager-67d95fdc48-zdzqz" (UID: "587a610a-fefb-4eec-b008-e89f1c5a79a5") : secret "llmisvc-webhook-server-cert" not found Jul 01 19:29:43.931877 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.931859 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354098ff-6784-45e5-9ff6-92ec0a390582-cert\") pod \"kserve-controller-manager-79d94fb575-d4mz5\" (UID: \"354098ff-6784-45e5-9ff6-92ec0a390582\") " pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:29:43.938572 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.938550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcn47\" (UniqueName: \"kubernetes.io/projected/354098ff-6784-45e5-9ff6-92ec0a390582-kube-api-access-qcn47\") pod \"kserve-controller-manager-79d94fb575-d4mz5\" (UID: \"354098ff-6784-45e5-9ff6-92ec0a390582\") " pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:29:43.938682 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:43.938623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dmjz\" (UniqueName: \"kubernetes.io/projected/587a610a-fefb-4eec-b008-e89f1c5a79a5-kube-api-access-7dmjz\") pod \"llmisvc-controller-manager-67d95fdc48-zdzqz\" (UID: \"587a610a-fefb-4eec-b008-e89f1c5a79a5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:44.031031 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.030964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dffe5c4d-0cde-44e1-8356-7ef992d85e1a-data\") pod \"seaweedfs-64568bcd49-dwwpp\" (UID: \"dffe5c4d-0cde-44e1-8356-7ef992d85e1a\") " pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:29:44.031031 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.030997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7nmt\" (UniqueName: \"kubernetes.io/projected/dffe5c4d-0cde-44e1-8356-7ef992d85e1a-kube-api-access-x7nmt\") pod \"seaweedfs-64568bcd49-dwwpp\" (UID: \"dffe5c4d-0cde-44e1-8356-7ef992d85e1a\") " pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:29:44.031413 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.031392 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dffe5c4d-0cde-44e1-8356-7ef992d85e1a-data\") pod \"seaweedfs-64568bcd49-dwwpp\" (UID: \"dffe5c4d-0cde-44e1-8356-7ef992d85e1a\") " pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:29:44.039448 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.039422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7nmt\" (UniqueName: \"kubernetes.io/projected/dffe5c4d-0cde-44e1-8356-7ef992d85e1a-kube-api-access-x7nmt\") pod \"seaweedfs-64568bcd49-dwwpp\" (UID: \"dffe5c4d-0cde-44e1-8356-7ef992d85e1a\") " pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:29:44.060222 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.060198 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:29:44.117725 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.117693 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:29:44.197517 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.197486 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-79d94fb575-d4mz5"] Jul 01 19:29:44.200030 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:29:44.200000 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354098ff_6784_45e5_9ff6_92ec0a390582.slice/crio-236c27580d377d46348dc33a5a816d38ed411505c4c7650967a47ea3d2cfa933 WatchSource:0}: Error finding container 236c27580d377d46348dc33a5a816d38ed411505c4c7650967a47ea3d2cfa933: Status 404 returned error can't find the container with id 236c27580d377d46348dc33a5a816d38ed411505c4c7650967a47ea3d2cfa933 Jul 01 19:29:44.210770 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.210721 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" event={"ID":"354098ff-6784-45e5-9ff6-92ec0a390582","Type":"ContainerStarted","Data":"236c27580d377d46348dc33a5a816d38ed411505c4c7650967a47ea3d2cfa933"} Jul 01 19:29:44.260644 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.260623 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-dwwpp"] Jul 01 19:29:44.263071 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:29:44.263045 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffe5c4d_0cde_44e1_8356_7ef992d85e1a.slice/crio-586586174b4e032b546eef03304f742036b38db7030660ca61d5007e34aa2c42 WatchSource:0}: Error finding container 586586174b4e032b546eef03304f742036b38db7030660ca61d5007e34aa2c42: Status 404 returned error can't find the container with id 586586174b4e032b546eef03304f742036b38db7030660ca61d5007e34aa2c42 Jul 01 19:29:44.433197 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.433132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/587a610a-fefb-4eec-b008-e89f1c5a79a5-cert\") pod \"llmisvc-controller-manager-67d95fdc48-zdzqz\" (UID: \"587a610a-fefb-4eec-b008-e89f1c5a79a5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:44.435618 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.435596 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/587a610a-fefb-4eec-b008-e89f1c5a79a5-cert\") pod \"llmisvc-controller-manager-67d95fdc48-zdzqz\" (UID: \"587a610a-fefb-4eec-b008-e89f1c5a79a5\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:44.667440 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.667411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:44.827305 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:44.827282 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-zdzqz"] Jul 01 19:29:44.829788 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:29:44.829757 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod587a610a_fefb_4eec_b008_e89f1c5a79a5.slice/crio-0bf33281dbb8bfba4ebd62946fdbf52c39a46c0ce8b5a7df9fb1b776571bfb6c WatchSource:0}: Error finding container 0bf33281dbb8bfba4ebd62946fdbf52c39a46c0ce8b5a7df9fb1b776571bfb6c: Status 404 returned error can't find the container with id 0bf33281dbb8bfba4ebd62946fdbf52c39a46c0ce8b5a7df9fb1b776571bfb6c Jul 01 19:29:45.219688 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:45.219544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-dwwpp" event={"ID":"dffe5c4d-0cde-44e1-8356-7ef992d85e1a","Type":"ContainerStarted","Data":"586586174b4e032b546eef03304f742036b38db7030660ca61d5007e34aa2c42"} Jul 01 19:29:45.221380 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:45.221332 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" event={"ID":"587a610a-fefb-4eec-b008-e89f1c5a79a5","Type":"ContainerStarted","Data":"0bf33281dbb8bfba4ebd62946fdbf52c39a46c0ce8b5a7df9fb1b776571bfb6c"} Jul 01 19:29:49.248331 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:49.248298 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-dwwpp" event={"ID":"dffe5c4d-0cde-44e1-8356-7ef992d85e1a","Type":"ContainerStarted","Data":"a6df2b9ce74e8f9bea3f2bbc04af95ba72d63ac365491b12216c73e666c8f6c8"} Jul 01 19:29:49.248692 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:49.248544 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:29:49.250254 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:49.250230 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" event={"ID":"354098ff-6784-45e5-9ff6-92ec0a390582","Type":"ContainerStarted","Data":"f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d"} Jul 01 19:29:49.250390 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:49.250351 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:29:49.265180 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:49.265142 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-dwwpp" podStartSLOduration=1.480904367 podStartE2EDuration="6.26513221s" totalImagesPullingTime="4.784227843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:49.264752386 +0000 UTC m=+434.351488258" watchObservedRunningTime="2026-07-01 19:29:49.26513221 +0000 UTC m=+434.351868048" Jul 01 19:29:49.280907 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:49.280872 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" podStartSLOduration=2.690971532 podStartE2EDuration="6.280860597s" totalImagesPullingTime="3.589889065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:49.279200082 +0000 UTC m=+434.365935943" watchObservedRunningTime="2026-07-01 19:29:49.280860597 +0000 UTC m=+434.367596457" Jul 01 19:29:50.256459 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:50.256424 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" event={"ID":"587a610a-fefb-4eec-b008-e89f1c5a79a5","Type":"ContainerStarted","Data":"ccb55494db92f3bd5542f84a5c2800e21787c56953d5fba6733a274775126690"} Jul 01 19:29:50.273755 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:50.273709 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" podStartSLOduration=3.00121554 podStartE2EDuration="7.273693663s" totalImagesPullingTime="4.272478123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:50.273475332 +0000 UTC m=+435.360211192" watchObservedRunningTime="2026-07-01 19:29:50.273693663 +0000 UTC m=+435.360429502" Jul 01 19:29:51.260965 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:51.260940 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:29:55.258162 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:29:55.258136 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-dwwpp" Jul 01 19:30:20.261609 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:20.261575 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:30:22.267788 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:22.267760 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-zdzqz" Jul 01 19:30:23.873941 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:23.873908 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-79d94fb575-d4mz5"] Jul 01 19:30:23.874402 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:23.874158 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" podUID="354098ff-6784-45e5-9ff6-92ec0a390582" containerName="manager" containerID="cri-o://f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d" gracePeriod=10 Jul 01 19:30:23.901932 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:23.901901 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-79d94fb575-9vg4d"] Jul 01 19:30:23.904291 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:23.904274 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:23.917670 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:23.917645 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-79d94fb575-9vg4d"] Jul 01 19:30:23.945989 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:23.945959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b70ffd23-67ec-4100-bbe5-629fa1f88820-cert\") pod \"kserve-controller-manager-79d94fb575-9vg4d\" (UID: \"b70ffd23-67ec-4100-bbe5-629fa1f88820\") " pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:23.946084 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:23.946008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrl6v\" (UniqueName: \"kubernetes.io/projected/b70ffd23-67ec-4100-bbe5-629fa1f88820-kube-api-access-rrl6v\") pod \"kserve-controller-manager-79d94fb575-9vg4d\" (UID: \"b70ffd23-67ec-4100-bbe5-629fa1f88820\") " pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:24.046936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.046907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrl6v\" (UniqueName: \"kubernetes.io/projected/b70ffd23-67ec-4100-bbe5-629fa1f88820-kube-api-access-rrl6v\") pod \"kserve-controller-manager-79d94fb575-9vg4d\" (UID: \"b70ffd23-67ec-4100-bbe5-629fa1f88820\") " pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:24.047084 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.046989 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b70ffd23-67ec-4100-bbe5-629fa1f88820-cert\") pod \"kserve-controller-manager-79d94fb575-9vg4d\" (UID: \"b70ffd23-67ec-4100-bbe5-629fa1f88820\") " pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:24.049759 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.049732 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b70ffd23-67ec-4100-bbe5-629fa1f88820-cert\") pod \"kserve-controller-manager-79d94fb575-9vg4d\" (UID: \"b70ffd23-67ec-4100-bbe5-629fa1f88820\") " pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:24.057688 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.057655 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrl6v\" (UniqueName: \"kubernetes.io/projected/b70ffd23-67ec-4100-bbe5-629fa1f88820-kube-api-access-rrl6v\") pod \"kserve-controller-manager-79d94fb575-9vg4d\" (UID: \"b70ffd23-67ec-4100-bbe5-629fa1f88820\") " pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:24.107283 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.107263 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:30:24.147563 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.147516 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354098ff-6784-45e5-9ff6-92ec0a390582-cert\") pod \"354098ff-6784-45e5-9ff6-92ec0a390582\" (UID: \"354098ff-6784-45e5-9ff6-92ec0a390582\") " Jul 01 19:30:24.147677 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.147619 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcn47\" (UniqueName: \"kubernetes.io/projected/354098ff-6784-45e5-9ff6-92ec0a390582-kube-api-access-qcn47\") pod \"354098ff-6784-45e5-9ff6-92ec0a390582\" (UID: \"354098ff-6784-45e5-9ff6-92ec0a390582\") " Jul 01 19:30:24.149948 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.149910 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/354098ff-6784-45e5-9ff6-92ec0a390582-cert" (OuterVolumeSpecName: "cert") pod "354098ff-6784-45e5-9ff6-92ec0a390582" (UID: "354098ff-6784-45e5-9ff6-92ec0a390582"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:30:24.150067 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.149920 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/354098ff-6784-45e5-9ff6-92ec0a390582-kube-api-access-qcn47" (OuterVolumeSpecName: "kube-api-access-qcn47") pod "354098ff-6784-45e5-9ff6-92ec0a390582" (UID: "354098ff-6784-45e5-9ff6-92ec0a390582"). InnerVolumeSpecName "kube-api-access-qcn47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:30:24.248482 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.248461 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcn47\" (UniqueName: \"kubernetes.io/projected/354098ff-6784-45e5-9ff6-92ec0a390582-kube-api-access-qcn47\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:30:24.248482 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.248483 2565 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354098ff-6784-45e5-9ff6-92ec0a390582-cert\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:30:24.265663 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.265645 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:24.393563 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.393504 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-79d94fb575-9vg4d"] Jul 01 19:30:24.395641 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:30:24.395617 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70ffd23_67ec_4100_bbe5_629fa1f88820.slice/crio-144aae1c0ba5bb4ff0c8fe2b3d6b194f213b7aa96ea16114ed9895185d96e6ce WatchSource:0}: Error finding container 144aae1c0ba5bb4ff0c8fe2b3d6b194f213b7aa96ea16114ed9895185d96e6ce: Status 404 returned error can't find the container with id 144aae1c0ba5bb4ff0c8fe2b3d6b194f213b7aa96ea16114ed9895185d96e6ce Jul 01 19:30:24.408574 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.408548 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" event={"ID":"b70ffd23-67ec-4100-bbe5-629fa1f88820","Type":"ContainerStarted","Data":"144aae1c0ba5bb4ff0c8fe2b3d6b194f213b7aa96ea16114ed9895185d96e6ce"} Jul 01 19:30:24.409737 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.409717 2565 generic.go:356] "Generic (PLEG): container finished" podID="354098ff-6784-45e5-9ff6-92ec0a390582" containerID="f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d" exitCode=0 Jul 01 19:30:24.409849 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.409761 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" Jul 01 19:30:24.409849 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.409772 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" event={"ID":"354098ff-6784-45e5-9ff6-92ec0a390582","Type":"ContainerDied","Data":"f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d"} Jul 01 19:30:24.409849 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.409831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79d94fb575-d4mz5" event={"ID":"354098ff-6784-45e5-9ff6-92ec0a390582","Type":"ContainerDied","Data":"236c27580d377d46348dc33a5a816d38ed411505c4c7650967a47ea3d2cfa933"} Jul 01 19:30:24.410005 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.409863 2565 scope.go:117] "RemoveContainer" containerID="f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d" Jul 01 19:30:24.418600 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.418586 2565 scope.go:117] "RemoveContainer" containerID="f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d" Jul 01 19:30:24.418850 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:30:24.418834 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d\": container with ID starting with f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d not found: ID does not exist" containerID="f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d" Jul 01 19:30:24.418910 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.418860 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d"} err="failed to get container status \"f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d\": rpc error: code = NotFound desc = could not find container \"f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d\": container with ID starting with f9d2140c95d13b7d233bddb38524d8e4ac9bdb7ce8abee4ff7fc9bc9eb3ba06d not found: ID does not exist" Jul 01 19:30:24.432075 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.432053 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-79d94fb575-d4mz5"] Jul 01 19:30:24.436535 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:24.436515 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-79d94fb575-d4mz5"] Jul 01 19:30:25.410087 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:25.410061 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="354098ff-6784-45e5-9ff6-92ec0a390582" path="/var/lib/kubelet/pods/354098ff-6784-45e5-9ff6-92ec0a390582/volumes" Jul 01 19:30:25.414799 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:25.414776 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" event={"ID":"b70ffd23-67ec-4100-bbe5-629fa1f88820","Type":"ContainerStarted","Data":"6922f88dbabb81ea5b9940257e42a87ca12e351d28965755732b01898c4dbffd"} Jul 01 19:30:25.414917 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:25.414835 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:25.435905 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:25.435858 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" podStartSLOduration=2.100483241 podStartE2EDuration="2.435844921s" totalImagesPullingTime="335.36168ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:30:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:30:25.43434016 +0000 UTC m=+470.521076020" watchObservedRunningTime="2026-07-01 19:30:25.435844921 +0000 UTC m=+470.522580792" Jul 01 19:30:56.424509 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:56.424479 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-79d94fb575-9vg4d" Jul 01 19:30:57.414786 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.414757 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-xf5bg"] Jul 01 19:30:57.415317 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.415291 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="354098ff-6784-45e5-9ff6-92ec0a390582" containerName="manager" Jul 01 19:30:57.415317 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.415308 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="354098ff-6784-45e5-9ff6-92ec0a390582" containerName="manager" Jul 01 19:30:57.415516 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.415404 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="354098ff-6784-45e5-9ff6-92ec0a390582" containerName="manager" Jul 01 19:30:57.417738 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.417721 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:30:57.420598 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.420579 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 01 19:30:57.420598 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.420589 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-2xghc\"" Jul 01 19:30:57.430312 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.430279 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-xf5bg"] Jul 01 19:30:57.513847 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.513817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452e8649-cdbc-4853-8492-8a80b9e12694-tls-certs\") pod \"model-serving-api-fd65d7d6-xf5bg\" (UID: \"452e8649-cdbc-4853-8492-8a80b9e12694\") " pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:30:57.514064 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.513958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84jdv\" (UniqueName: \"kubernetes.io/projected/452e8649-cdbc-4853-8492-8a80b9e12694-kube-api-access-84jdv\") pod \"model-serving-api-fd65d7d6-xf5bg\" (UID: \"452e8649-cdbc-4853-8492-8a80b9e12694\") " pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:30:57.559643 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.559606 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f59d75989-j94wj"] Jul 01 19:30:57.561895 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.561875 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.580658 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.580627 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f59d75989-j94wj"] Jul 01 19:30:57.615740 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.615704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452e8649-cdbc-4853-8492-8a80b9e12694-tls-certs\") pod \"model-serving-api-fd65d7d6-xf5bg\" (UID: \"452e8649-cdbc-4853-8492-8a80b9e12694\") " pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:30:57.615936 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.615760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84jdv\" (UniqueName: \"kubernetes.io/projected/452e8649-cdbc-4853-8492-8a80b9e12694-kube-api-access-84jdv\") pod \"model-serving-api-fd65d7d6-xf5bg\" (UID: \"452e8649-cdbc-4853-8492-8a80b9e12694\") " pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:30:57.615936 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:30:57.615887 2565 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 01 19:30:57.616028 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:30:57.615971 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452e8649-cdbc-4853-8492-8a80b9e12694-tls-certs podName:452e8649-cdbc-4853-8492-8a80b9e12694 nodeName:}" failed. No retries permitted until 2026-07-01 19:30:58.115948533 +0000 UTC m=+503.202684376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/452e8649-cdbc-4853-8492-8a80b9e12694-tls-certs") pod "model-serving-api-fd65d7d6-xf5bg" (UID: "452e8649-cdbc-4853-8492-8a80b9e12694") : secret "model-serving-api-tls" not found Jul 01 19:30:57.625770 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.625741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84jdv\" (UniqueName: \"kubernetes.io/projected/452e8649-cdbc-4853-8492-8a80b9e12694-kube-api-access-84jdv\") pod \"model-serving-api-fd65d7d6-xf5bg\" (UID: \"452e8649-cdbc-4853-8492-8a80b9e12694\") " pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:30:57.716979 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.716880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/157c8ff5-a699-4237-b290-9229d21cea2c-console-serving-cert\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.716979 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.716919 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-oauth-serving-cert\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.716979 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.716940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltn27\" (UniqueName: \"kubernetes.io/projected/157c8ff5-a699-4237-b290-9229d21cea2c-kube-api-access-ltn27\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.716979 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.716958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/157c8ff5-a699-4237-b290-9229d21cea2c-console-oauth-config\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.717317 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.717022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-trusted-ca-bundle\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.717317 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.717084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-console-config\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.717317 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.717163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-service-ca\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.818019 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.817975 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-oauth-serving-cert\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.818019 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.818021 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltn27\" (UniqueName: \"kubernetes.io/projected/157c8ff5-a699-4237-b290-9229d21cea2c-kube-api-access-ltn27\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.818249 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.818041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/157c8ff5-a699-4237-b290-9229d21cea2c-console-oauth-config\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.818249 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.818058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-trusted-ca-bundle\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.818249 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.818093 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-console-config\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.818249 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.818181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-service-ca\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.818249 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.818239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/157c8ff5-a699-4237-b290-9229d21cea2c-console-serving-cert\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.818983 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.818946 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-service-ca\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.819098 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.818996 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-trusted-ca-bundle\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.819146 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.819132 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-oauth-serving-cert\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.819181 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.819130 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/157c8ff5-a699-4237-b290-9229d21cea2c-console-config\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.820791 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.820763 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/157c8ff5-a699-4237-b290-9229d21cea2c-console-oauth-config\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.820877 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.820768 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/157c8ff5-a699-4237-b290-9229d21cea2c-console-serving-cert\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.826879 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.826861 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltn27\" (UniqueName: \"kubernetes.io/projected/157c8ff5-a699-4237-b290-9229d21cea2c-kube-api-access-ltn27\") pod \"console-6f59d75989-j94wj\" (UID: \"157c8ff5-a699-4237-b290-9229d21cea2c\") " pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:57.871793 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:57.871763 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:30:58.008651 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:58.008617 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f59d75989-j94wj"] Jul 01 19:30:58.012432 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:30:58.012406 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157c8ff5_a699_4237_b290_9229d21cea2c.slice/crio-d1fe5c6ac1dc10d050523429d631579ddc3153bc95ae190365948deefbec697f WatchSource:0}: Error finding container d1fe5c6ac1dc10d050523429d631579ddc3153bc95ae190365948deefbec697f: Status 404 returned error can't find the container with id d1fe5c6ac1dc10d050523429d631579ddc3153bc95ae190365948deefbec697f Jul 01 19:30:58.120451 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:58.120415 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452e8649-cdbc-4853-8492-8a80b9e12694-tls-certs\") pod \"model-serving-api-fd65d7d6-xf5bg\" (UID: \"452e8649-cdbc-4853-8492-8a80b9e12694\") " pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:30:58.123101 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:58.123067 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452e8649-cdbc-4853-8492-8a80b9e12694-tls-certs\") pod \"model-serving-api-fd65d7d6-xf5bg\" (UID: \"452e8649-cdbc-4853-8492-8a80b9e12694\") " pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:30:58.328791 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:58.328682 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:30:58.463850 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:58.463805 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-xf5bg"] Jul 01 19:30:58.565351 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:58.565309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f59d75989-j94wj" event={"ID":"157c8ff5-a699-4237-b290-9229d21cea2c","Type":"ContainerStarted","Data":"94e5dc825a2854569f084369da56a4c816e05c710dbfc3f52e2d1b2e8cc25883"} Jul 01 19:30:58.565578 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:58.565433 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f59d75989-j94wj" event={"ID":"157c8ff5-a699-4237-b290-9229d21cea2c","Type":"ContainerStarted","Data":"d1fe5c6ac1dc10d050523429d631579ddc3153bc95ae190365948deefbec697f"} Jul 01 19:30:58.566528 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:58.566499 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-xf5bg" event={"ID":"452e8649-cdbc-4853-8492-8a80b9e12694","Type":"ContainerStarted","Data":"aba400c5ec129bd58edaabe33812b68574de26fabaea7f061671c862f33b5419"} Jul 01 19:30:58.585958 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:30:58.585860 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f59d75989-j94wj" podStartSLOduration=1.5858486520000001 podStartE2EDuration="1.585848652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:30:58.584555119 +0000 UTC m=+503.671290979" watchObservedRunningTime="2026-07-01 19:30:58.585848652 +0000 UTC m=+503.672584573" Jul 01 19:31:01.586224 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:01.586191 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-xf5bg" event={"ID":"452e8649-cdbc-4853-8492-8a80b9e12694","Type":"ContainerStarted","Data":"d21b7d2b516f23d9462ed607f335679e6cfb4b4f60928d4e73cf3ea46b8a669d"} Jul 01 19:31:01.586601 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:01.586339 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:31:01.603876 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:01.603833 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-xf5bg" podStartSLOduration=2.30376257 podStartE2EDuration="4.603817963s" totalImagesPullingTime="2.300055393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:31:01.601867983 +0000 UTC m=+506.688603844" watchObservedRunningTime="2026-07-01 19:31:01.603817963 +0000 UTC m=+506.690553822" Jul 01 19:31:07.872232 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:07.872200 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:31:07.872627 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:07.872255 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:31:07.877006 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:07.876988 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:31:08.620174 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:08.620147 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f59d75989-j94wj" Jul 01 19:31:08.674910 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:08.674880 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f579b49-sgxtc"] Jul 01 19:31:12.595318 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:12.595285 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-xf5bg" Jul 01 19:31:33.696087 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:33.695979 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8f579b49-sgxtc" podUID="9ca27ff5-31a1-47ad-a7ea-afb666a72c93" containerName="console" containerID="cri-o://80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac" gracePeriod=15 Jul 01 19:31:33.938519 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:33.938493 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:31:34.021970 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.021945 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9vt6\" (UniqueName: \"kubernetes.io/projected/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-kube-api-access-x9vt6\") pod \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " Jul 01 19:31:34.022108 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.021992 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-trusted-ca-bundle\") pod \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " Jul 01 19:31:34.022108 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.022013 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-oauth-config\") pod \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " Jul 01 19:31:34.022108 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.022048 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-config\") pod \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " Jul 01 19:31:34.022108 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.022077 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-oauth-serving-cert\") pod \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " Jul 01 19:31:34.022108 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.022097 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-service-ca\") pod \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " Jul 01 19:31:34.022329 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.022130 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-serving-cert\") pod \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\" (UID: \"9ca27ff5-31a1-47ad-a7ea-afb666a72c93\") " Jul 01 19:31:34.022550 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.022524 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9ca27ff5-31a1-47ad-a7ea-afb666a72c93" (UID: "9ca27ff5-31a1-47ad-a7ea-afb666a72c93"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:31:34.022659 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.022601 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-config" (OuterVolumeSpecName: "console-config") pod "9ca27ff5-31a1-47ad-a7ea-afb666a72c93" (UID: "9ca27ff5-31a1-47ad-a7ea-afb666a72c93"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:31:34.022659 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.022629 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-service-ca" (OuterVolumeSpecName: "service-ca") pod "9ca27ff5-31a1-47ad-a7ea-afb666a72c93" (UID: "9ca27ff5-31a1-47ad-a7ea-afb666a72c93"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:31:34.022659 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.022637 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9ca27ff5-31a1-47ad-a7ea-afb666a72c93" (UID: "9ca27ff5-31a1-47ad-a7ea-afb666a72c93"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:31:34.024246 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.024220 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-kube-api-access-x9vt6" (OuterVolumeSpecName: "kube-api-access-x9vt6") pod "9ca27ff5-31a1-47ad-a7ea-afb666a72c93" (UID: "9ca27ff5-31a1-47ad-a7ea-afb666a72c93"). InnerVolumeSpecName "kube-api-access-x9vt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:31:34.024335 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.024244 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9ca27ff5-31a1-47ad-a7ea-afb666a72c93" (UID: "9ca27ff5-31a1-47ad-a7ea-afb666a72c93"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:31:34.024335 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.024299 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9ca27ff5-31a1-47ad-a7ea-afb666a72c93" (UID: "9ca27ff5-31a1-47ad-a7ea-afb666a72c93"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:31:34.123484 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.123436 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-trusted-ca-bundle\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:31:34.123484 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.123477 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-oauth-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:31:34.123484 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.123488 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-config\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:31:34.123484 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.123497 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-oauth-serving-cert\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:31:34.123484 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.123505 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-service-ca\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:31:34.123768 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.123513 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-console-serving-cert\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:31:34.123768 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.123522 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9vt6\" (UniqueName: \"kubernetes.io/projected/9ca27ff5-31a1-47ad-a7ea-afb666a72c93-kube-api-access-x9vt6\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:31:34.730744 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.730709 2565 generic.go:356] "Generic (PLEG): container finished" podID="9ca27ff5-31a1-47ad-a7ea-afb666a72c93" containerID="80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac" exitCode=0 Jul 01 19:31:34.731126 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.730752 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f579b49-sgxtc" Jul 01 19:31:34.731126 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.730789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f579b49-sgxtc" event={"ID":"9ca27ff5-31a1-47ad-a7ea-afb666a72c93","Type":"ContainerDied","Data":"80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac"} Jul 01 19:31:34.731126 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.730836 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f579b49-sgxtc" event={"ID":"9ca27ff5-31a1-47ad-a7ea-afb666a72c93","Type":"ContainerDied","Data":"e9bcb472130351bc319be934bb888eae7cf8ab3a42f66aa2a31f1db0c3da208e"} Jul 01 19:31:34.731126 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.730855 2565 scope.go:117] "RemoveContainer" containerID="80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac" Jul 01 19:31:34.739681 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.739664 2565 scope.go:117] "RemoveContainer" containerID="80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac" Jul 01 19:31:34.739930 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:31:34.739904 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac\": container with ID starting with 80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac not found: ID does not exist" containerID="80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac" Jul 01 19:31:34.739992 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.739938 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac"} err="failed to get container status \"80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac\": rpc error: code = NotFound desc = could not find container \"80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac\": container with ID starting with 80c6e8115f19ab30a89d7970a41ca8f9d551b2f0ef79e676c4e742c973253dac not found: ID does not exist" Jul 01 19:31:34.751608 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.751586 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f579b49-sgxtc"] Jul 01 19:31:34.755396 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:34.755352 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8f579b49-sgxtc"] Jul 01 19:31:35.409947 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:31:35.409922 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca27ff5-31a1-47ad-a7ea-afb666a72c93" path="/var/lib/kubelet/pods/9ca27ff5-31a1-47ad-a7ea-afb666a72c93/volumes" Jul 01 19:36:21.154990 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.154951 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4"] Jul 01 19:36:21.155560 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.155544 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca27ff5-31a1-47ad-a7ea-afb666a72c93" containerName="console" Jul 01 19:36:21.155612 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.155562 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca27ff5-31a1-47ad-a7ea-afb666a72c93" containerName="console" Jul 01 19:36:21.155653 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.155616 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca27ff5-31a1-47ad-a7ea-afb666a72c93" containerName="console" Jul 01 19:36:21.158809 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.158791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:21.161296 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.161270 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 19:36:21.161450 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.161431 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-54928-serving-cert\"" Jul 01 19:36:21.162042 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.162026 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-54928-kube-rbac-proxy-sar-config\"" Jul 01 19:36:21.162143 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.162041 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-bqdbq\"" Jul 01 19:36:21.169793 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.169769 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4"] Jul 01 19:36:21.215428 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.215401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-openshift-service-ca-bundle\") pod \"model-chainer-raw-54928-7944f78864-9qnp4\" (UID: \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\") " pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:21.215539 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.215439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-proxy-tls\") pod \"model-chainer-raw-54928-7944f78864-9qnp4\" (UID: \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\") " pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:21.316560 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.316530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-openshift-service-ca-bundle\") pod \"model-chainer-raw-54928-7944f78864-9qnp4\" (UID: \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\") " pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:21.316699 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.316573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-proxy-tls\") pod \"model-chainer-raw-54928-7944f78864-9qnp4\" (UID: \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\") " pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:21.317136 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.317110 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-openshift-service-ca-bundle\") pod \"model-chainer-raw-54928-7944f78864-9qnp4\" (UID: \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\") " pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:21.319146 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.319116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-proxy-tls\") pod \"model-chainer-raw-54928-7944f78864-9qnp4\" (UID: \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\") " pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:21.471395 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.471316 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:21.601522 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.601501 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4"] Jul 01 19:36:21.604107 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:36:21.604082 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571fc2f2_c1ae_405b_9a58_3bce68abbf8e.slice/crio-bce17d7275dfc7d13bcc742009fc41842bb401fbbca54f7effa7e5e09d7e1c5f WatchSource:0}: Error finding container bce17d7275dfc7d13bcc742009fc41842bb401fbbca54f7effa7e5e09d7e1c5f: Status 404 returned error can't find the container with id bce17d7275dfc7d13bcc742009fc41842bb401fbbca54f7effa7e5e09d7e1c5f Jul 01 19:36:21.608398 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.608353 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:36:21.976052 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:21.976018 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" event={"ID":"571fc2f2-c1ae-405b-9a58-3bce68abbf8e","Type":"ContainerStarted","Data":"bce17d7275dfc7d13bcc742009fc41842bb401fbbca54f7effa7e5e09d7e1c5f"} Jul 01 19:36:24.995179 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:24.995140 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" event={"ID":"571fc2f2-c1ae-405b-9a58-3bce68abbf8e","Type":"ContainerStarted","Data":"a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613"} Jul 01 19:36:24.995583 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:24.995264 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:25.011342 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:25.011299 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" podStartSLOduration=1.23036618 podStartE2EDuration="4.011287126s" totalImagesPullingTime="2.780920946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:36:25.010485499 +0000 UTC m=+830.097221361" watchObservedRunningTime="2026-07-01 19:36:25.011287126 +0000 UTC m=+830.098022985" Jul 01 19:36:31.005021 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:31.004992 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:31.192712 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:31.192681 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4"] Jul 01 19:36:31.192886 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:31.192865 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" containerID="cri-o://a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613" gracePeriod=30 Jul 01 19:36:36.003785 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:36.003743 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:36:41.003133 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:41.003095 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:36:46.003785 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:46.003745 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:36:46.004190 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:46.003855 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:36:51.003832 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:51.003784 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:36:56.003286 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:36:56.003240 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:37:01.003099 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:01.003050 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:37:01.343412 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:01.343390 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:37:01.447481 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:01.447450 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-proxy-tls\") pod \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\" (UID: \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\") " Jul 01 19:37:01.447625 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:01.447566 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-openshift-service-ca-bundle\") pod \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\" (UID: \"571fc2f2-c1ae-405b-9a58-3bce68abbf8e\") " Jul 01 19:37:01.447937 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:01.447901 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "571fc2f2-c1ae-405b-9a58-3bce68abbf8e" (UID: "571fc2f2-c1ae-405b-9a58-3bce68abbf8e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:37:01.449700 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:01.449668 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "571fc2f2-c1ae-405b-9a58-3bce68abbf8e" (UID: "571fc2f2-c1ae-405b-9a58-3bce68abbf8e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:37:01.548297 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:01.548229 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-openshift-service-ca-bundle\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:37:01.548297 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:01.548254 2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/571fc2f2-c1ae-405b-9a58-3bce68abbf8e-proxy-tls\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:37:02.166725 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:02.166696 2565 generic.go:356] "Generic (PLEG): container finished" podID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerID="a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613" exitCode=0 Jul 01 19:37:02.167184 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:02.166739 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" Jul 01 19:37:02.167184 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:02.166789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" event={"ID":"571fc2f2-c1ae-405b-9a58-3bce68abbf8e","Type":"ContainerDied","Data":"a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613"} Jul 01 19:37:02.167184 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:02.166852 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4" event={"ID":"571fc2f2-c1ae-405b-9a58-3bce68abbf8e","Type":"ContainerDied","Data":"bce17d7275dfc7d13bcc742009fc41842bb401fbbca54f7effa7e5e09d7e1c5f"} Jul 01 19:37:02.167184 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:02.166887 2565 scope.go:117] "RemoveContainer" containerID="a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613" Jul 01 19:37:02.175758 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:02.175744 2565 scope.go:117] "RemoveContainer" containerID="a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613" Jul 01 19:37:02.175985 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:37:02.175968 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613\": container with ID starting with a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613 not found: ID does not exist" containerID="a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613" Jul 01 19:37:02.176030 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:02.175993 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613"} err="failed to get container status \"a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613\": rpc error: code = NotFound desc = could not find container \"a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613\": container with ID starting with a8cf4d217d46f24a54ce2b6772fc2972357ef260566f999b2011d5f02c07c613 not found: ID does not exist" Jul 01 19:37:02.187178 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:02.187156 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4"] Jul 01 19:37:02.191012 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:02.190995 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-54928-7944f78864-9qnp4"] Jul 01 19:37:03.409654 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:37:03.409625 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" path="/var/lib/kubelet/pods/571fc2f2-c1ae-405b-9a58-3bce68abbf8e/volumes" Jul 01 19:38:11.437145 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.437111 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t"] Jul 01 19:38:11.437620 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.437471 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" Jul 01 19:38:11.437620 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.437483 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" Jul 01 19:38:11.437620 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.437542 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="571fc2f2-c1ae-405b-9a58-3bce68abbf8e" containerName="model-chainer-raw-54928" Jul 01 19:38:11.439560 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.439542 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:11.441819 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.441795 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-31388-serving-cert\"" Jul 01 19:38:11.441916 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.441858 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 19:38:11.442644 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.442626 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-bqdbq\"" Jul 01 19:38:11.442735 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.442626 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-31388-kube-rbac-proxy-sar-config\"" Jul 01 19:38:11.450523 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.450499 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t"] Jul 01 19:38:11.487735 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.487708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-31388-7fb588c955-rf75t\" (UID: \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:11.487846 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.487828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-proxy-tls\") pod \"model-chainer-raw-hpa-31388-7fb588c955-rf75t\" (UID: \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:11.588995 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.588966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-proxy-tls\") pod \"model-chainer-raw-hpa-31388-7fb588c955-rf75t\" (UID: \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:11.589121 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.589022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-31388-7fb588c955-rf75t\" (UID: \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:11.589121 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:38:11.589101 2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-31388-serving-cert: secret "model-chainer-raw-hpa-31388-serving-cert" not found Jul 01 19:38:11.589204 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:38:11.589172 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-proxy-tls podName:de2c3f44-6369-4549-84ba-b1b2c1a7a0d4 nodeName:}" failed. No retries permitted until 2026-07-01 19:38:12.089156707 +0000 UTC m=+937.175892549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-proxy-tls") pod "model-chainer-raw-hpa-31388-7fb588c955-rf75t" (UID: "de2c3f44-6369-4549-84ba-b1b2c1a7a0d4") : secret "model-chainer-raw-hpa-31388-serving-cert" not found Jul 01 19:38:11.589611 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:11.589595 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-31388-7fb588c955-rf75t\" (UID: \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:12.094294 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:12.094262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-proxy-tls\") pod \"model-chainer-raw-hpa-31388-7fb588c955-rf75t\" (UID: \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:12.096852 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:12.096830 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-proxy-tls\") pod \"model-chainer-raw-hpa-31388-7fb588c955-rf75t\" (UID: \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:12.351692 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:12.351616 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:12.480054 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:12.480029 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t"] Jul 01 19:38:12.482262 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:38:12.482237 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2c3f44_6369_4549_84ba_b1b2c1a7a0d4.slice/crio-3495ab02feaf7ec3b2ae8aecbcd0d92255296bbd9657a806e6ce1e5628383b17 WatchSource:0}: Error finding container 3495ab02feaf7ec3b2ae8aecbcd0d92255296bbd9657a806e6ce1e5628383b17: Status 404 returned error can't find the container with id 3495ab02feaf7ec3b2ae8aecbcd0d92255296bbd9657a806e6ce1e5628383b17 Jul 01 19:38:13.489870 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:13.489838 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" event={"ID":"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4","Type":"ContainerStarted","Data":"1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13"} Jul 01 19:38:13.490240 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:13.489886 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" event={"ID":"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4","Type":"ContainerStarted","Data":"3495ab02feaf7ec3b2ae8aecbcd0d92255296bbd9657a806e6ce1e5628383b17"} Jul 01 19:38:13.490240 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:13.489974 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:13.510043 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:13.509998 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" podStartSLOduration=2.509982699 podStartE2EDuration="2.509982699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:38:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:38:13.508514599 +0000 UTC m=+938.595250460" watchObservedRunningTime="2026-07-01 19:38:13.509982699 +0000 UTC m=+938.596718560" Jul 01 19:38:19.500052 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:19.500019 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:21.475171 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:21.475139 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t"] Jul 01 19:38:21.475577 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:21.475373 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" containerID="cri-o://1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13" gracePeriod=30 Jul 01 19:38:24.498439 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:24.498398 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:38:29.498590 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:29.498554 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:38:34.498845 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:34.498808 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:38:34.499270 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:34.498929 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:39.498954 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:39.498914 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:38:44.500973 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:44.500932 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:38:49.498889 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:49.498854 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 19:38:51.619608 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.619586 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:51.665932 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.665896 2565 generic.go:356] "Generic (PLEG): container finished" podID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerID="1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13" exitCode=0 Jul 01 19:38:51.666107 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.665949 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" Jul 01 19:38:51.666107 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.665976 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" event={"ID":"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4","Type":"ContainerDied","Data":"1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13"} Jul 01 19:38:51.666107 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.666028 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t" event={"ID":"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4","Type":"ContainerDied","Data":"3495ab02feaf7ec3b2ae8aecbcd0d92255296bbd9657a806e6ce1e5628383b17"} Jul 01 19:38:51.666107 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.666049 2565 scope.go:117] "RemoveContainer" containerID="1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13" Jul 01 19:38:51.674267 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.674250 2565 scope.go:117] "RemoveContainer" containerID="1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13" Jul 01 19:38:51.674554 ip-10-0-131-235 kubenswrapper[2565]: E0701 19:38:51.674537 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13\": container with ID starting with 1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13 not found: ID does not exist" containerID="1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13" Jul 01 19:38:51.674619 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.674562 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13"} err="failed to get container status \"1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13\": rpc error: code = NotFound desc = could not find container \"1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13\": container with ID starting with 1311683e0056f2bf711d67832941a47c2a87ae72e1f62039cf2019eb2c2ceb13 not found: ID does not exist" Jul 01 19:38:51.721511 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.721487 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-openshift-service-ca-bundle\") pod \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\" (UID: \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\") " Jul 01 19:38:51.721624 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.721531 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-proxy-tls\") pod \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\" (UID: \"de2c3f44-6369-4549-84ba-b1b2c1a7a0d4\") " Jul 01 19:38:51.721819 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.721797 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" (UID: "de2c3f44-6369-4549-84ba-b1b2c1a7a0d4"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:38:51.723691 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.723668 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" (UID: "de2c3f44-6369-4549-84ba-b1b2c1a7a0d4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:38:51.822564 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.822535 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-openshift-service-ca-bundle\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:38:51.822564 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.822562 2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4-proxy-tls\") on node \"ip-10-0-131-235.ec2.internal\" DevicePath \"\"" Jul 01 19:38:51.987393 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.987346 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t"] Jul 01 19:38:51.991241 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:51.991221 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-31388-7fb588c955-rf75t"] Jul 01 19:38:53.409521 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:38:53.409488 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" path="/var/lib/kubelet/pods/de2c3f44-6369-4549-84ba-b1b2c1a7a0d4/volumes" Jul 01 19:48:50.360748 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:50.360720 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qvdtj_a9484aaf-f96b-44f2-b188-e15736f70dc9/global-pull-secret-syncer/0.log" Jul 01 19:48:50.461007 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:50.460978 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mmnqc_03e4406e-8f58-49e5-8c7f-8e57a4dd0ffd/konnectivity-agent/0.log" Jul 01 19:48:50.526110 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:50.526081 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-235.ec2.internal_847db0cc99df2dba82bff072bfa78f80/haproxy/0.log" Jul 01 19:48:53.701764 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:53.701735 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f381d44e-3c12-447e-9c05-837eef5f6778/alertmanager/0.log" Jul 01 19:48:53.732833 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:53.732811 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f381d44e-3c12-447e-9c05-837eef5f6778/config-reloader/0.log" Jul 01 19:48:53.759173 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:53.759141 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f381d44e-3c12-447e-9c05-837eef5f6778/kube-rbac-proxy-web/0.log" Jul 01 19:48:53.788992 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:53.788970 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f381d44e-3c12-447e-9c05-837eef5f6778/kube-rbac-proxy/0.log" Jul 01 19:48:53.822156 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:53.822139 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f381d44e-3c12-447e-9c05-837eef5f6778/kube-rbac-proxy-metric/0.log" Jul 01 19:48:53.862348 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:53.862322 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f381d44e-3c12-447e-9c05-837eef5f6778/prom-label-proxy/0.log" Jul 01 19:48:53.894534 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:53.894514 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f381d44e-3c12-447e-9c05-837eef5f6778/init-config-reloader/0.log" Jul 01 19:48:53.947430 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:53.947408 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-vsvjt_363376e8-8b45-4ae0-8fd8-4150d1915f4c/cluster-monitoring-operator/0.log" Jul 01 19:48:53.980919 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:53.980858 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-n4rsq_3d6722b1-2e36-467a-99e8-c8c8102a0df5/kube-state-metrics/0.log" Jul 01 19:48:54.017376 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.017347 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-n4rsq_3d6722b1-2e36-467a-99e8-c8c8102a0df5/kube-rbac-proxy-main/0.log" Jul 01 19:48:54.045831 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.045789 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-n4rsq_3d6722b1-2e36-467a-99e8-c8c8102a0df5/kube-rbac-proxy-self/0.log" Jul 01 19:48:54.125116 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.125084 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-qpggr_2295b78a-aad4-4ef5-8483-63d09b18f80e/monitoring-plugin/0.log" Jul 01 19:48:54.389397 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.389353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kdhhs_0081e0c7-c1c2-4ef0-8234-a907741ce270/node-exporter/0.log" Jul 01 19:48:54.422795 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.422765 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kdhhs_0081e0c7-c1c2-4ef0-8234-a907741ce270/kube-rbac-proxy/0.log" Jul 01 19:48:54.463937 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.463917 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kdhhs_0081e0c7-c1c2-4ef0-8234-a907741ce270/init-textfile/0.log" Jul 01 19:48:54.888187 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.888154 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-f82s4_2780e4fd-7f90-47a5-a4bb-acf94b7947bc/prometheus-operator/0.log" Jul 01 19:48:54.916222 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.916201 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-f82s4_2780e4fd-7f90-47a5-a4bb-acf94b7947bc/kube-rbac-proxy/0.log" Jul 01 19:48:54.946323 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.946299 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-lbnh5_e0cdb357-3002-4e60-b595-085d6e366807/prometheus-operator-admission-webhook/0.log" Jul 01 19:48:54.979347 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:54.979324 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6777d747b9-ln8cc_5e8cf33d-81aa-479e-87ad-94b9712689ab/telemeter-client/0.log" Jul 01 19:48:55.009925 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:55.009901 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6777d747b9-ln8cc_5e8cf33d-81aa-479e-87ad-94b9712689ab/reload/0.log" Jul 01 19:48:55.041213 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:55.041189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6777d747b9-ln8cc_5e8cf33d-81aa-479e-87ad-94b9712689ab/kube-rbac-proxy/0.log" Jul 01 19:48:57.718758 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:57.718724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f59d75989-j94wj_157c8ff5-a699-4237-b290-9229d21cea2c/console/0.log" Jul 01 19:48:58.311929 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.311895 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-qnt95_c5b9d090-5e5f-407b-b99d-a481f81e8996/volume-data-source-validator/0.log" Jul 01 19:48:58.484581 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.484547 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t"] Jul 01 19:48:58.484915 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.484901 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" Jul 01 19:48:58.484959 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.484920 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" Jul 01 19:48:58.485002 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.484991 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de2c3f44-6369-4549-84ba-b1b2c1a7a0d4" containerName="model-chainer-raw-hpa-31388" Jul 01 19:48:58.487534 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.487513 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.489963 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.489943 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-726bc\"/\"openshift-service-ca.crt\"" Jul 01 19:48:58.490098 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.490006 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-726bc\"/\"default-dockercfg-rqmdg\"" Jul 01 19:48:58.491484 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.491468 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-726bc\"/\"kube-root-ca.crt\"" Jul 01 19:48:58.499031 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.499011 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t"] Jul 01 19:48:58.601304 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.601235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-lib-modules\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.601304 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.601285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2w8\" (UniqueName: \"kubernetes.io/projected/248e95e9-e1f5-4247-80db-324f6a66f6a8-kube-api-access-9x2w8\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.601530 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.601355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-proc\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.601530 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.601412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-sys\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.601530 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.601462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-podres\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.702041 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.702006 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-podres\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.702168 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.702051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-lib-modules\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.702168 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.702091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2w8\" (UniqueName: \"kubernetes.io/projected/248e95e9-e1f5-4247-80db-324f6a66f6a8-kube-api-access-9x2w8\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.702168 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.702133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-proc\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.702168 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.702160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-sys\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.702346 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.702186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-podres\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.702346 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.702242 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-lib-modules\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.702346 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.702246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-proc\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.702346 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.702247 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/248e95e9-e1f5-4247-80db-324f6a66f6a8-sys\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.711470 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.711445 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2w8\" (UniqueName: \"kubernetes.io/projected/248e95e9-e1f5-4247-80db-324f6a66f6a8-kube-api-access-9x2w8\") pod \"perf-node-gather-daemonset-pqx2t\" (UID: \"248e95e9-e1f5-4247-80db-324f6a66f6a8\") " pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.797453 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.797429 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:58.928623 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:58.928590 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t"] Jul 01 19:48:58.931628 ip-10-0-131-235 kubenswrapper[2565]: W0701 19:48:58.931594 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod248e95e9_e1f5_4247_80db_324f6a66f6a8.slice/crio-db240429700bf7e99fd9a657743dcd6825e244553c11a66645ccf0d641abb9a6 WatchSource:0}: Error finding container db240429700bf7e99fd9a657743dcd6825e244553c11a66645ccf0d641abb9a6: Status 404 returned error can't find the container with id db240429700bf7e99fd9a657743dcd6825e244553c11a66645ccf0d641abb9a6 Jul 01 19:48:59.329627 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:59.329589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" event={"ID":"248e95e9-e1f5-4247-80db-324f6a66f6a8","Type":"ContainerStarted","Data":"9427e6e96fb76a2037bc610e3bb03a452fb36183202a3733f41445d99a1761ac"} Jul 01 19:48:59.329773 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:59.329650 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" event={"ID":"248e95e9-e1f5-4247-80db-324f6a66f6a8","Type":"ContainerStarted","Data":"db240429700bf7e99fd9a657743dcd6825e244553c11a66645ccf0d641abb9a6"} Jul 01 19:48:59.329773 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:59.329676 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:48:59.350063 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:59.350022 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" podStartSLOduration=1.350007206 podStartE2EDuration="1.350007206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:48:59.347903619 +0000 UTC m=+1584.434639480" watchObservedRunningTime="2026-07-01 19:48:59.350007206 +0000 UTC m=+1584.436743066" Jul 01 19:48:59.399707 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:59.399673 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k2dw2_c9eff814-7447-4424-a1db-78f99451f0ad/dns/0.log" Jul 01 19:48:59.441699 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:59.441670 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k2dw2_c9eff814-7447-4424-a1db-78f99451f0ad/kube-rbac-proxy/0.log" Jul 01 19:48:59.618602 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:48:59.618521 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f6c4k_1ad5feee-db3d-494d-b5d9-676907e21fa0/dns-node-resolver/0.log" Jul 01 19:49:00.159243 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:00.159210 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-57f4846bd6-w4sxh_c3afe3a0-9e95-4a38-9b8e-cc6bd0991271/registry/0.log" Jul 01 19:49:00.239283 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:00.239259 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v5wqc_400fbd2a-170e-4079-bd8e-b16907259376/node-ca/0.log" Jul 01 19:49:01.647005 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:01.646972 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qzlkr_1e279fbb-1137-427a-9e11-a880f1febe7d/serve-healthcheck-canary/0.log" Jul 01 19:49:02.053785 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:02.053751 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-whnqd_d16cf183-6132-401c-b4d0-de32c5efd8a6/insights-operator/0.log" Jul 01 19:49:02.054168 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:02.054151 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-whnqd_d16cf183-6132-401c-b4d0-de32c5efd8a6/insights-operator/1.log" Jul 01 19:49:02.270756 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:02.270726 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqkbd_44b2486a-f99b-464d-bd3e-4324394f88cc/kube-rbac-proxy/0.log" Jul 01 19:49:02.298459 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:02.298429 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqkbd_44b2486a-f99b-464d-bd3e-4324394f88cc/exporter/0.log" Jul 01 19:49:02.323675 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:02.323597 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqkbd_44b2486a-f99b-464d-bd3e-4324394f88cc/extractor/0.log" Jul 01 19:49:04.470719 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:04.470681 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-79d94fb575-9vg4d_b70ffd23-67ec-4100-bbe5-629fa1f88820/manager/0.log" Jul 01 19:49:04.495430 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:04.495406 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-zdzqz_587a610a-fefb-4eec-b008-e89f1c5a79a5/manager/0.log" Jul 01 19:49:04.520314 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:04.520296 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-xf5bg_452e8649-cdbc-4853-8492-8a80b9e12694/server/0.log" Jul 01 19:49:04.708716 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:04.708686 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-dwwpp_dffe5c4d-0cde-44e1-8356-7ef992d85e1a/seaweedfs/0.log" Jul 01 19:49:05.344617 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:05.344594 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-726bc/perf-node-gather-daemonset-pqx2t" Jul 01 19:49:10.405423 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:10.405395 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7dcjg_93615ebb-d773-4a72-94fe-10aadb4187a5/kube-multus/0.log" Jul 01 19:49:10.626430 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:10.626401 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwlqs_b7dffa21-9e3e-4c53-9a39-4bec05893e52/kube-multus-additional-cni-plugins/0.log" Jul 01 19:49:10.652462 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:10.652442 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwlqs_b7dffa21-9e3e-4c53-9a39-4bec05893e52/egress-router-binary-copy/0.log" Jul 01 19:49:10.681754 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:10.681696 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwlqs_b7dffa21-9e3e-4c53-9a39-4bec05893e52/cni-plugins/0.log" Jul 01 19:49:10.706766 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:10.706748 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwlqs_b7dffa21-9e3e-4c53-9a39-4bec05893e52/bond-cni-plugin/0.log" Jul 01 19:49:10.733692 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:10.733675 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwlqs_b7dffa21-9e3e-4c53-9a39-4bec05893e52/routeoverride-cni/0.log" Jul 01 19:49:10.758956 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:10.758939 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwlqs_b7dffa21-9e3e-4c53-9a39-4bec05893e52/whereabouts-cni-bincopy/0.log" Jul 01 19:49:10.784213 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:10.784191 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kwlqs_b7dffa21-9e3e-4c53-9a39-4bec05893e52/whereabouts-cni/0.log" Jul 01 19:49:11.139035 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:11.139002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rh76h_0732f1f3-9b70-4a07-b1a7-2ce3d36291e3/network-metrics-daemon/0.log" Jul 01 19:49:11.164412 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:11.164391 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rh76h_0732f1f3-9b70-4a07-b1a7-2ce3d36291e3/kube-rbac-proxy/0.log" Jul 01 19:49:12.257488 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:12.257458 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpjdc_0928bd05-a7e2-4498-bdaf-a70c08b988a0/ovn-controller/0.log" Jul 01 19:49:12.279893 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:12.279871 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpjdc_0928bd05-a7e2-4498-bdaf-a70c08b988a0/ovn-acl-logging/0.log" Jul 01 19:49:12.311046 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:12.311024 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpjdc_0928bd05-a7e2-4498-bdaf-a70c08b988a0/kube-rbac-proxy-node/0.log" Jul 01 19:49:12.338774 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:12.338754 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpjdc_0928bd05-a7e2-4498-bdaf-a70c08b988a0/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 19:49:12.369662 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:12.369643 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpjdc_0928bd05-a7e2-4498-bdaf-a70c08b988a0/northd/0.log" Jul 01 19:49:12.401260 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:12.401238 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpjdc_0928bd05-a7e2-4498-bdaf-a70c08b988a0/nbdb/0.log" Jul 01 19:49:12.427789 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:12.427762 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpjdc_0928bd05-a7e2-4498-bdaf-a70c08b988a0/sbdb/0.log" Jul 01 19:49:12.492418 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:12.492396 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kpjdc_0928bd05-a7e2-4498-bdaf-a70c08b988a0/ovnkube-controller/0.log" Jul 01 19:49:13.770608 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:13.770579 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56499946bc-mdcrp_38fe9315-d4b0-4ddc-ad7c-0a704080a97d/check-endpoints/0.log" Jul 01 19:49:13.852084 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:13.852063 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vw4mh_20ac655e-bd97-431c-86ff-5af517032e3d/network-check-target-container/0.log" Jul 01 19:49:14.860678 ip-10-0-131-235 kubenswrapper[2565]: I0701 19:49:14.860644 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-m7lb5_91579e6e-91eb-49bc-8bee-85ac55c7c80a/iptables-alerter/0.log"