Jul 28 17:07:11.563937 ip-10-0-128-156 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 17:07:11.563950 ip-10-0-128-156 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 17:07:11.563961 ip-10-0-128-156 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 17:07:11.564288 ip-10-0-128-156 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 17:07:21.585234 ip-10-0-128-156 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 17:07:21.585252 ip-10-0-128-156 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8e59db6df1e44c0292826d8a9e3fd473 -- Jul 28 17:09:21.225122 ip-10-0-128-156 systemd[1]: Starting Kubernetes Kubelet... Jul 28 17:09:22.944544 ip-10-0-128-156 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:09:22.944544 ip-10-0-128-156 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 17:09:22.944544 ip-10-0-128-156 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:09:22.944544 ip-10-0-128-156 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 17:09:22.944544 ip-10-0-128-156 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:09:22.946991 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.946885 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 17:09:22.951463 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951447 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:22.951463 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951463 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951467 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951471 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951474 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951476 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951479 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951481 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951484 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951487 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951490 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951492 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951495 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951497 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951500 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951502 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951510 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951512 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951515 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951518 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951520 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:22.951527 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951524 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951526 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951529 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951532 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951535 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951538 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951541 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951545 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951550 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951552 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951555 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951557 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951560 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951563 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951565 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951567 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951570 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951572 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951575 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:22.952049 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951577 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951580 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951583 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951585 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951588 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951590 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951592 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951595 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951597 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951600 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951602 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951605 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951607 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951610 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951613 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951616 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951619 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951621 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951624 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:22.952506 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951626 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951629 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951632 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951634 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951636 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951639 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951641 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951644 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951647 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951650 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951652 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951655 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951657 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951660 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951663 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951665 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951668 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951671 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951673 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951676 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:22.952987 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951678 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951681 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951683 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951685 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951689 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951692 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951694 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951696 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951700 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951703 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951706 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951708 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951711 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951713 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951716 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951718 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951722 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951726 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951730 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:22.953469 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.951733 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952473 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952481 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952483 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952486 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952489 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952492 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952495 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952497 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952500 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952503 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952506 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952508 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952511 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952514 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952516 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952519 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952524 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952527 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952530 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:22.953940 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952533 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952536 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952540 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952543 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952546 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952548 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952551 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952554 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952557 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952560 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952562 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952565 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952567 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952570 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952572 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952575 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952577 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952580 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952582 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952585 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:22.954429 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952588 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952591 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952593 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952596 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952598 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952602 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952605 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952607 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952610 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952612 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952615 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952617 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952620 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952623 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952625 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952628 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952631 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952633 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952635 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:22.954938 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952638 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952640 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952643 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952645 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952649 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952652 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952654 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952657 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952659 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952661 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952664 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952667 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952669 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952672 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952675 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952677 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952680 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952683 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952685 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952688 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952690 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:22.955399 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952693 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952695 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952698 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952701 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952703 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952707 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952709 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952712 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952714 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952717 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952720 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952723 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952728 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952731 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952733 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952736 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952739 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952741 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952744 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:22.955914 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.952746 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953130 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953136 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953138 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953141 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953145 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953148 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953151 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953153 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953156 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953158 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953161 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953164 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953166 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953169 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953171 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953177 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953179 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953182 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953185 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:22.956415 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953188 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953190 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953193 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953196 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953198 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953202 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953206 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953208 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953211 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953213 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953216 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953219 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953222 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953224 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953227 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953230 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953232 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953235 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953242 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953245 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:22.956955 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953248 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953250 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953253 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953255 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953258 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953261 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953263 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953266 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953270 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953272 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953275 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953278 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953281 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953284 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953287 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953289 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953292 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953295 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953297 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:22.957437 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953300 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953302 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953305 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953307 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953310 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953312 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953315 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953319 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953322 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953325 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953328 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953330 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953334 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953337 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953340 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953342 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953344 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953349 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953353 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:22.957892 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953355 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953358 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953362 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953365 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953368 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953371 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953373 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953376 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953378 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953381 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953383 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953385 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953388 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953390 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953393 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953395 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953398 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953400 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953403 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953405 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:22.958393 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953408 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.953410 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953479 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953490 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953500 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953507 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953514 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953519 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953525 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953529 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953532 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953535 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953539 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953542 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953546 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953550 2582 flags.go:64] FLAG: --cgroup-root="" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953553 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953556 2582 flags.go:64] FLAG: --client-ca-file="" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953559 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953561 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953567 2582 flags.go:64] FLAG: --cluster-domain="" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953570 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953573 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953576 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 17:09:22.958876 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953579 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953583 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953586 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953590 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953593 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953596 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953599 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953602 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953605 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953608 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953612 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953615 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953618 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953621 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953624 2582 flags.go:64] FLAG: --enable-server="true" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953627 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953631 2582 flags.go:64] FLAG: --event-burst="100" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953634 2582 flags.go:64] FLAG: --event-qps="50" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953637 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953640 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953643 2582 flags.go:64] FLAG: --eviction-hard="" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953646 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953649 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953655 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953657 2582 flags.go:64] FLAG: --eviction-soft="" Jul 28 17:09:22.959468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953660 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953664 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953667 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953670 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953673 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953676 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953679 2582 flags.go:64] FLAG: --feature-gates="" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953682 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953685 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953689 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953691 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953695 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953698 2582 flags.go:64] FLAG: --help="false" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953700 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-128-156.ec2.internal" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953704 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953706 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953709 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953713 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953716 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953719 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953722 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953725 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953728 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 17:09:22.960089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953732 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953735 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953738 2582 flags.go:64] FLAG: --kube-reserved="" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953741 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953744 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953747 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953750 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953754 2582 flags.go:64] FLAG: --lock-file="" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953757 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953760 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953763 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953768 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953771 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953774 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953777 2582 flags.go:64] FLAG: --logging-format="text" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953780 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953784 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953787 2582 flags.go:64] FLAG: --manifest-url="" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953790 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953794 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953797 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953801 2582 flags.go:64] FLAG: --max-pods="110" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953804 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953807 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953810 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 17:09:22.960671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953812 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953816 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953819 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953821 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953829 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953832 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953835 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953838 2582 flags.go:64] FLAG: --pod-cidr="" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953841 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953846 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953849 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953852 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953855 2582 flags.go:64] FLAG: --port="10250" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953858 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953862 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0db8234fd25e40843" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953866 2582 flags.go:64] FLAG: --qos-reserved="" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953868 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953871 2582 flags.go:64] FLAG: --register-node="true" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953874 2582 flags.go:64] FLAG: --register-with-taints="" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953877 2582 flags.go:64] FLAG: --registry-burst="10" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953880 2582 flags.go:64] FLAG: --registry-qps="5" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953883 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953886 2582 flags.go:64] FLAG: --reserved-memory="" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953889 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953892 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 17:09:22.961284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953895 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953898 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953901 2582 flags.go:64] FLAG: --runonce="false" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953904 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953907 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953910 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953912 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953915 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953918 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953936 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953939 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953942 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953945 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953948 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953951 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953954 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953958 2582 flags.go:64] FLAG: --system-cgroups="" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953961 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953966 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953969 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953972 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953977 2582 flags.go:64] FLAG: --tls-min-version="" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953980 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953983 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953986 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 17:09:22.961935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953989 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953992 2582 flags.go:64] FLAG: --v="2" Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.953996 2582 flags.go:64] FLAG: --version="false" Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.954000 2582 flags.go:64] FLAG: --vmodule="" Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.954004 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.954007 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954560 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954565 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954568 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954571 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954574 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954577 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954579 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954582 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954585 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954587 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954591 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954594 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954597 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954599 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954602 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:22.962589 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954605 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954607 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954610 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954613 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954616 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954618 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954621 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954625 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954627 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954630 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954632 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954635 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954637 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954640 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954642 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954645 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954648 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954650 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954653 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954656 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:22.963116 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954658 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954661 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954663 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954666 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954668 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954671 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954681 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954685 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954688 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954691 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954695 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954699 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954702 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954704 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954707 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954711 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954716 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954719 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954721 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:22.963595 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954726 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954729 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954732 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954736 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954739 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954742 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954745 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954748 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954750 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954753 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954756 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954758 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954761 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954764 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954766 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954769 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954771 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954774 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954776 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:22.964121 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954779 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954784 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954786 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954789 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954792 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954794 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954797 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954799 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954802 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954805 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954807 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954810 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954813 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954817 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954819 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954822 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954824 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954827 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954829 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954832 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:22.964579 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954835 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954837 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954840 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954842 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954845 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.954847 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.955402 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.962456 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.962473 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.962493 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.962499 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962574 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962579 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962582 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:22.965074 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962584 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962588 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962590 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962593 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962596 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962599 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962602 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962605 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962607 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962611 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962616 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962619 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962622 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962624 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962627 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962630 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962632 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962635 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962637 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962640 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:22.965423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962643 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962646 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962648 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962651 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962653 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962656 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962665 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962668 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962671 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962683 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962686 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962688 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962691 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962696 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962700 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962703 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962706 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962709 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962712 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:22.965899 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962715 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962717 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962720 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962723 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962725 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962728 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962730 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962733 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962735 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962738 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962741 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962743 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962746 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962748 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962751 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962753 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962756 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962758 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962762 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962765 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:22.966366 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962774 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962778 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962780 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962783 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962785 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962788 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962791 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962793 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962796 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962798 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962801 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962804 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962806 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962808 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962811 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962813 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962816 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962819 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962821 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962824 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:22.966863 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962826 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962829 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962831 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962834 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962838 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962841 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962844 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962846 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962849 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962852 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962855 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962858 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962861 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962869 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962872 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962875 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:22.967363 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.962877 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.962883 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963055 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963061 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963064 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963067 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963070 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963072 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963075 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963077 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963080 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963083 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963085 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963088 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:22.967763 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963092 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963096 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963098 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963101 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963104 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963106 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963109 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963111 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963113 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963116 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963119 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963121 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963124 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963127 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963130 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963133 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963142 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963145 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963148 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963150 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:22.968112 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963153 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963155 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963158 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963160 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963164 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963168 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963171 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963175 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963178 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963182 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963184 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963187 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963190 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963193 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963195 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963198 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963201 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963204 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963206 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:22.968592 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963209 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963211 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963213 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963216 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963219 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963222 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963224 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963227 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963230 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963233 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963243 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963246 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963255 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963257 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963260 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963263 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963265 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963267 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963270 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963272 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:22.969148 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963275 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963278 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963280 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963282 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963285 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963288 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963290 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963292 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963295 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963297 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963300 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963302 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963305 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963307 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963310 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963313 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963315 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963318 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963320 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963323 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:22.969650 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963325 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963328 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963330 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963338 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963341 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963343 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963346 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:22.963348 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.963353 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.963473 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.965541 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.966939 2582 server.go:1019] "Starting client certificate rotation" Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.967040 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:09:22.970139 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.967077 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:09:22.970455 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.969511 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:09:22.975074 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.975050 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:09:22.987755 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.987734 2582 log.go:25] "Validated CRI v1 runtime API" Jul 28 17:09:22.989821 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.989804 2582 log.go:25] "Validated CRI v1 image API" Jul 28 17:09:22.990664 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.990644 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 17:09:22.992983 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.992966 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 99b9ce14-8a14-42cc-878e-4bb3656fd735:/dev/nvme0n1p3 dbcdaeb9-3fb6-43b5-ba3a-d6f89420e619:/dev/nvme0n1p4] Jul 28 17:09:22.993030 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.992984 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 17:09:22.997199 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.997084 2582 manager.go:216] Machine: {Timestamp:2026-07-28 17:09:22.996592029 +0000 UTC m=+0.338751371 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101546 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e3ad5ac48e4952c94a9202353041 SystemUUID:ec24e3ad-5ac4-8e49-52c9-4a9202353041 BootID:8e59db6d-f1e4-4c02-9282-6d8a9e3fd473 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:61:ba:2e:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:61:ba:2e:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:62:95:43:c0:33 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 17:09:22.997199 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.997189 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 17:09:22.997358 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:22.997267 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 17:09:23.000104 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.000074 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 17:09:23.000273 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.000106 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-156.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 17:09:23.000912 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.000900 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 17:09:23.000985 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.000916 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 17:09:23.000985 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.000947 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:09:23.001803 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.001791 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:09:23.002970 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.002957 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 17:09:23.006093 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.006075 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:09:23.006653 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.006640 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:09:23.006810 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.006799 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 17:09:23.006867 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.006844 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 28 17:09:23.006941 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.006869 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 17:09:23.006941 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.006884 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 17:09:23.006941 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.006902 2582 kubelet.go:398] "Adding apiserver pod source" Jul 28 17:09:23.006941 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.006914 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 17:09:23.007340 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.007326 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:09:23.007402 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.007348 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:09:23.009953 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.009919 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 17:09:23.013072 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013046 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 17:09:23.013157 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013098 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 17:09:23.013795 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013730 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 17:09:23.013795 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013752 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 17:09:23.013795 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013761 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 17:09:23.013795 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013772 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 17:09:23.014002 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013843 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 17:09:23.014002 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013882 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 17:09:23.014002 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013898 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 17:09:23.014002 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013906 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 17:09:23.014002 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013945 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 17:09:23.014002 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013952 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 17:09:23.014002 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013962 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 17:09:23.014002 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.013971 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 17:09:23.014708 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.014457 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 17:09:23.014808 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.014720 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 17:09:23.017316 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.017297 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-156.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 17:09:23.017434 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.017415 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 17:09:23.017481 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.017412 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 17:09:23.018106 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.018091 2582 server.go:1268] "Started kubelet" Jul 28 17:09:23.018209 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.018185 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 17:09:23.018260 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.018169 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 17:09:23.018308 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.018269 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 17:09:23.018913 ip-10-0-128-156 systemd[1]: Started Kubernetes Kubelet. Jul 28 17:09:23.019989 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.019975 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 17:09:23.020328 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.020308 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 28 17:09:23.023398 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.023372 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 17:09:23.023487 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.023405 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb746" Jul 28 17:09:23.023557 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.022622 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-156.ec2.internal.18c6833450ea790e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-156.ec2.internal,UID:ip-10-0-128-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-156.ec2.internal,},FirstTimestamp:2026-07-28 17:09:23.018062094 +0000 UTC m=+0.360221435,LastTimestamp:2026-07-28 17:09:23.018062094 +0000 UTC m=+0.360221435,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-156.ec2.internal,}" Jul 28 17:09:23.028720 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.028703 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 17:09:23.029059 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.029042 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 17:09:23.029161 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.029142 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.029617 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.029602 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 17:09:23.029617 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.029619 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 17:09:23.029739 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.029619 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 17:09:23.029739 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.029703 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 28 17:09:23.029739 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.029712 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 28 17:09:23.030368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.030355 2582 factory.go:55] Registering systemd factory Jul 28 17:09:23.030410 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.030379 2582 factory.go:223] Registration of the systemd container factory successfully Jul 28 17:09:23.030585 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.030571 2582 factory.go:153] Registering CRI-O factory Jul 28 17:09:23.030637 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.030589 2582 factory.go:223] Registration of the crio container factory successfully Jul 28 17:09:23.030668 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.030642 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 17:09:23.030668 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.030660 2582 factory.go:103] Registering Raw factory Jul 28 17:09:23.030754 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.030671 2582 manager.go:1196] Started watching for new ooms in manager Jul 28 17:09:23.031162 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.031145 2582 manager.go:349] Starting recovery of all containers Jul 28 17:09:23.031262 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.031225 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb746" Jul 28 17:09:23.037294 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.037250 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 17:09:23.039242 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.039217 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 17:09:23.039348 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.039312 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 17:09:23.043353 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.043333 2582 manager.go:354] Recovery completed Jul 28 17:09:23.048444 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.048431 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:23.050341 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.050326 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:23.050389 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.050355 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:23.050389 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.050365 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:23.050971 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.050954 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:23.050971 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.050965 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 17:09:23.051083 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.050978 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 17:09:23.051083 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.050994 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:09:23.051530 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.051514 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:23.051594 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.051546 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:23.051594 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.051561 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:23.053029 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.053015 2582 policy_none.go:49] "None policy: Start" Jul 28 17:09:23.053095 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.053033 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 17:09:23.053095 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.053043 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 17:09:23.054947 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.054937 2582 policy_none.go:47] "Start" Jul 28 17:09:23.093608 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.093450 2582 manager.go:337] "Starting Device Plugin manager" Jul 28 17:09:23.093713 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.093632 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 17:09:23.093713 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.093643 2582 server.go:87] "Starting device plugin registration server" Jul 28 17:09:23.093852 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.093841 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 17:09:23.093901 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.093854 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 17:09:23.093974 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.093966 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 17:09:23.094048 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.094034 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 17:09:23.094048 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.094046 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 17:09:23.094538 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.094516 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 17:09:23.094624 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.094563 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.194155 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.194127 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:23.196152 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.195056 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:23.196152 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.195103 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:23.196152 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.195115 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:23.196152 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.195142 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.202490 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.202475 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.202539 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.202497 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-156.ec2.internal\": node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.214623 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.214603 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.254356 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.254330 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 17:09:23.254460 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.254371 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 17:09:23.254460 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.254393 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 17:09:23.254460 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.254426 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 17:09:23.256762 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.256741 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:23.314834 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.314807 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.355244 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.355205 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal"] Jul 28 17:09:23.355323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.355288 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:23.356863 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.356846 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:23.356918 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.356881 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:23.356918 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.356893 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:23.359087 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.359075 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:23.359194 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.359179 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.359233 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.359210 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:23.359842 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.359826 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:23.359946 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.359829 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:23.359946 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.359881 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:23.359946 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.359896 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:23.359946 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.359852 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:23.359946 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.359939 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:23.362070 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.362054 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.362167 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.362076 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:23.362717 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.362704 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:23.362790 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.362727 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:23.362790 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.362738 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:23.394603 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.394577 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-156.ec2.internal\" not found" node="ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.397839 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.397822 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-156.ec2.internal\" not found" node="ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.415284 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.415267 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.431309 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.431289 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d66673e539a82e82550c56d52df9dc8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-156.ec2.internal\" (UID: \"0d66673e539a82e82550c56d52df9dc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.431368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.431314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/077a024c76d4b2dd7ce11113e9a0b5c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"077a024c76d4b2dd7ce11113e9a0b5c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.431368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.431334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/077a024c76d4b2dd7ce11113e9a0b5c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"077a024c76d4b2dd7ce11113e9a0b5c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.516138 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.516068 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.532411 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.532391 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d66673e539a82e82550c56d52df9dc8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-156.ec2.internal\" (UID: \"0d66673e539a82e82550c56d52df9dc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.532473 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.532416 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/077a024c76d4b2dd7ce11113e9a0b5c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"077a024c76d4b2dd7ce11113e9a0b5c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.532473 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.532433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/077a024c76d4b2dd7ce11113e9a0b5c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"077a024c76d4b2dd7ce11113e9a0b5c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.532473 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.532459 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/077a024c76d4b2dd7ce11113e9a0b5c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"077a024c76d4b2dd7ce11113e9a0b5c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.532560 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.532490 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d66673e539a82e82550c56d52df9dc8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-156.ec2.internal\" (UID: \"0d66673e539a82e82550c56d52df9dc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.532560 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.532496 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/077a024c76d4b2dd7ce11113e9a0b5c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal\" (UID: \"077a024c76d4b2dd7ce11113e9a0b5c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.616620 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.616590 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.697100 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.697065 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.700746 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.700730 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 28 17:09:23.717048 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.717017 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.817582 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.817478 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.918016 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:23.917985 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:23.935294 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.935274 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:23.966509 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.966484 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 17:09:23.966944 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.966604 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:09:23.966944 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:23.966632 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:09:24.018158 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:24.018125 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:24.043560 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:24.043529 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:04:23 +0000 UTC" deadline="2028-02-11 08:40:02.778040282 +0000 UTC" Jul 28 17:09:24.043560 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:24.043553 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13503h30m38.734489341s" Jul 28 17:09:24.118940 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:24.118858 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:24.219415 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:24.219357 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-156.ec2.internal\" not found" Jul 28 17:09:24.273227 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:24.273199 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:24.300812 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:24.300791 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:24.329695 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:24.329672 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" Jul 28 17:09:24.345767 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:24.345745 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:09:24.346892 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:24.346879 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" Jul 28 17:09:24.356658 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:24.356640 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:09:24.623806 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:24.623774 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077a024c76d4b2dd7ce11113e9a0b5c1.slice/crio-c18b570c754625e000b4d5c641700b9fad604f56b06c6e8b5fdb9e9d7960b967 WatchSource:0}: Error finding container c18b570c754625e000b4d5c641700b9fad604f56b06c6e8b5fdb9e9d7960b967: Status 404 returned error can't find the container with id c18b570c754625e000b4d5c641700b9fad604f56b06c6e8b5fdb9e9d7960b967 Jul 28 17:09:24.634572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:24.634555 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:09:24.645538 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:24.645513 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d66673e539a82e82550c56d52df9dc8.slice/crio-c72902f9602a92c2c5d858e91772015815e95d038fd34afebe1031b0bfe67941 WatchSource:0}: Error finding container c72902f9602a92c2c5d858e91772015815e95d038fd34afebe1031b0bfe67941: Status 404 returned error can't find the container with id c72902f9602a92c2c5d858e91772015815e95d038fd34afebe1031b0bfe67941 Jul 28 17:09:25.008307 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.008226 2582 apiserver.go:52] "Watching apiserver" Jul 28 17:09:25.018098 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.018041 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 17:09:25.019694 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.019661 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-99s7f","openshift-multus/network-metrics-daemon-t2sqf","openshift-ovn-kubernetes/ovnkube-node-xrs4m","kube-system/global-pull-secret-syncer-jk4l4","kube-system/konnectivity-agent-9vrfp","kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8","openshift-multus/multus-additional-cni-plugins-bwr67","openshift-network-diagnostics/network-check-target-mp4jl","openshift-network-operator/iptables-alerter-jznmz","openshift-cluster-node-tuning-operator/tuned-zpwvd","openshift-dns/node-resolver-kqr4w","openshift-image-registry/node-ca-5ch8f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal"] Jul 28 17:09:25.022331 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.022314 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.024250 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.024229 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.025318 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.025294 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 17:09:25.025476 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.025459 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 17:09:25.025521 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.025498 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pt99j\"" Jul 28 17:09:25.025558 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.025515 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 17:09:25.026397 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.026378 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.026651 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.026546 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 17:09:25.026651 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.026551 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 17:09:25.027072 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.027056 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7n8hl\"" Jul 28 17:09:25.027167 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.027084 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 17:09:25.028885 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.028862 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 17:09:25.029012 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.028961 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.029070 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.029030 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:25.029070 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.029058 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 17:09:25.029223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.029123 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 17:09:25.029223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.029184 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-njvj2\"" Jul 28 17:09:25.029335 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.029270 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 17:09:25.029335 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.029297 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 17:09:25.029446 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.029099 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 17:09:25.029580 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.029560 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 17:09:25.031917 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.031901 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:25.034131 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.034111 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 17:09:25.034218 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.034180 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.034279 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.034242 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 17:09:25.034337 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.034285 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-glp7v\"" Jul 28 17:09:25.036420 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.036404 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:25.036487 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.036454 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:25.037307 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.037286 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 17:09:25.037307 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.037296 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 17:09:25.037472 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.037377 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pzmm8\"" Jul 28 17:09:25.037472 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.037391 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 17:09:25.037472 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.037379 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 17:09:25.037691 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.037676 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 17:09:25.038633 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.038615 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.040186 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040171 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-cni-bin\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.040266 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040192 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ab10076-672a-4497-b3a7-7748c94ec5c0-ovnkube-config\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.040266 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040207 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.040266 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040223 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-sys-fs\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.040368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040241 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkkkk\" (UniqueName: \"kubernetes.io/projected/0a8de880-d4ae-479c-a1fa-24542a000e2d-kube-api-access-vkkkk\") pod \"node-ca-5ch8f\" (UID: \"0a8de880-d4ae-479c-a1fa-24542a000e2d\") " pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.040368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040297 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-etc-openvswitch\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.040368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-run-ovn\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.040368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040330 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ab10076-672a-4497-b3a7-7748c94ec5c0-ovn-node-metrics-cert\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.040368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e6f3e76-1c4e-477c-8cbe-150e96f8b72d-agent-certs\") pod \"konnectivity-agent-9vrfp\" (UID: \"6e6f3e76-1c4e-477c-8cbe-150e96f8b72d\") " pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:25.040368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7qsn\" (UniqueName: \"kubernetes.io/projected/4f590fce-a040-4a88-899f-d493c1e482e9-kube-api-access-w7qsn\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.040570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ab10076-672a-4497-b3a7-7748c94ec5c0-env-overrides\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.040570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040386 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e6f3e76-1c4e-477c-8cbe-150e96f8b72d-konnectivity-ca\") pod \"konnectivity-agent-9vrfp\" (UID: \"6e6f3e76-1c4e-477c-8cbe-150e96f8b72d\") " pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:25.040570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040400 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-socket-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.040570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040421 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-registration-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.040570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040460 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-device-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.040570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040484 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-run-systemd\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.040570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040503 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-run-openvswitch\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.040570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040523 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.040570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040541 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1532bb2e-4650-4582-aa75-6714e5c29108-kubelet-config\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1532bb2e-4650-4582-aa75-6714e5c29108-dbus\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-run-netns\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040670 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a8de880-d4ae-479c-a1fa-24542a000e2d-serviceca\") pod \"node-ca-5ch8f\" (UID: \"0a8de880-d4ae-479c-a1fa-24542a000e2d\") " pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040717 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040751 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040765 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040775 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-log-socket\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040799 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-cni-netd\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040822 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r94dt\" (UniqueName: \"kubernetes.io/projected/6ab10076-672a-4497-b3a7-7748c94ec5c0-kube-api-access-r94dt\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-slash\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040889 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4q7f4\"" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.040889 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.040988 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-var-lib-openvswitch\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.041036 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-node-log\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.041060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ab10076-672a-4497-b3a7-7748c94ec5c0-ovnkube-script-lib\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.041081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a8de880-d4ae-479c-a1fa-24542a000e2d-host\") pod \"node-ca-5ch8f\" (UID: \"0a8de880-d4ae-479c-a1fa-24542a000e2d\") " pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.041918 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.041125 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-kubelet\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.041918 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.041186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-systemd-units\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.043140 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.043127 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.045606 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.045584 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:09:25.045696 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.045641 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jch8b\"" Jul 28 17:09:25.045770 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.045750 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.045770 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.045762 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 17:09:25.045995 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.045976 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 17:09:25.047216 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.046860 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:09:25.049812 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.048989 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:09:25.049812 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.049083 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g64rv\"" Jul 28 17:09:25.049812 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.049321 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 17:09:25.050038 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.050009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.052774 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.052749 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 17:09:25.052877 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.052825 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lzdzb\"" Jul 28 17:09:25.052877 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.052846 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 17:09:25.068414 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.068286 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gz9ck" Jul 28 17:09:25.076619 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.076599 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gz9ck" Jul 28 17:09:25.131068 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.131043 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 17:09:25.141424 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141397 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v7rn\" (UniqueName: \"kubernetes.io/projected/42642d3c-a017-4969-8415-87c24243cf65-kube-api-access-4v7rn\") pod \"node-resolver-kqr4w\" (UID: \"42642d3c-a017-4969-8415-87c24243cf65\") " pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.141572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141441 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-var-lib-cni-multus\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.141572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141466 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-multus-conf-dir\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.141572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141493 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ab10076-672a-4497-b3a7-7748c94ec5c0-ovnkube-script-lib\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.141572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-system-cni-dir\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.141572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141539 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76mnw\" (UniqueName: \"kubernetes.io/projected/f78774be-c7f7-43ae-a745-08394c8732b1-kube-api-access-76mnw\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:25.141572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141559 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-kubernetes\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.141857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141589 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-system-cni-dir\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.141857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-systemd-units\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.141857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141798 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ab10076-672a-4497-b3a7-7748c94ec5c0-ovnkube-config\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.141857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141831 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-systemd-units\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.142051 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141882 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.142051 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.141914 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-cnibin\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.142051 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-sys-fs\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.142051 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.142018 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:25.142051 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-etc-openvswitch\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.142245 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.142093 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret podName:1532bb2e-4650-4582-aa75-6714e5c29108 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:25.642072271 +0000 UTC m=+2.984231605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret") pod "global-pull-secret-syncer-jk4l4" (UID: "1532bb2e-4650-4582-aa75-6714e5c29108") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:25.142245 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-run-ovn\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.142245 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142159 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjlbb\" (UniqueName: \"kubernetes.io/projected/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-kube-api-access-tjlbb\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.142245 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142187 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-hostroot\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.142426 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142249 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-sys-fs\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.142426 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142273 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-etc-openvswitch\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.142426 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142293 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ab10076-672a-4497-b3a7-7748c94ec5c0-ovnkube-script-lib\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.142426 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142330 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e6f3e76-1c4e-477c-8cbe-150e96f8b72d-konnectivity-ca\") pod \"konnectivity-agent-9vrfp\" (UID: \"6e6f3e76-1c4e-477c-8cbe-150e96f8b72d\") " pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:25.142426 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142358 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c5f4cb9-150e-49a1-89e8-02a5cdf8819d-host-slash\") pod \"iptables-alerter-jznmz\" (UID: \"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d\") " pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.142426 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142294 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-run-ovn\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.142426 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-lib-modules\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.142426 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42642d3c-a017-4969-8415-87c24243cf65-hosts-file\") pod \"node-resolver-kqr4w\" (UID: \"42642d3c-a017-4969-8415-87c24243cf65\") " pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-socket-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142487 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-registration-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-run-openvswitch\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142600 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-socket-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142607 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1532bb2e-4650-4582-aa75-6714e5c29108-kubelet-config\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142633 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-run-openvswitch\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142633 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1532bb2e-4650-4582-aa75-6714e5c29108-dbus\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-modprobe-d\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-sysconfig\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142717 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ab10076-672a-4497-b3a7-7748c94ec5c0-ovnkube-config\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142762 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142776 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1532bb2e-4650-4582-aa75-6714e5c29108-dbus\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142781 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-run-netns\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-run-netns\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142794 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1532bb2e-4650-4582-aa75-6714e5c29108-kubelet-config\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.143025 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142810 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-systemd\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142827 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80ac223f-ed41-475c-a79a-1e830b4d20d1-tmp\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142830 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-registration-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142845 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aef4695-ff40-4b36-8b91-09d435defed0-multus-daemon-config\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142881 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142907 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a8de880-d4ae-479c-a1fa-24542a000e2d-serviceca\") pod \"node-ca-5ch8f\" (UID: \"0a8de880-d4ae-479c-a1fa-24542a000e2d\") " pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142961 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e6f3e76-1c4e-477c-8cbe-150e96f8b72d-konnectivity-ca\") pod \"konnectivity-agent-9vrfp\" (UID: \"6e6f3e76-1c4e-477c-8cbe-150e96f8b72d\") " pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.142979 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143004 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-run\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7s8n\" (UniqueName: \"kubernetes.io/projected/8aef4695-ff40-4b36-8b91-09d435defed0-kube-api-access-m7s8n\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143054 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-cni-binary-copy\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143113 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143131 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-run-multus-certs\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-slash\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-var-lib-openvswitch\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-node-log\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.143806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-sysctl-d\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143287 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-sysctl-conf\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143291 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a8de880-d4ae-479c-a1fa-24542a000e2d-serviceca\") pod \"node-ca-5ch8f\" (UID: \"0a8de880-d4ae-479c-a1fa-24542a000e2d\") " pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143310 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c5f4cb9-150e-49a1-89e8-02a5cdf8819d-iptables-alerter-script\") pod \"iptables-alerter-jznmz\" (UID: \"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d\") " pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143354 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-var-lib-openvswitch\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143357 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-slash\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143388 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-node-log\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143394 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrrlx\" (UniqueName: \"kubernetes.io/projected/5c5f4cb9-150e-49a1-89e8-02a5cdf8819d-kube-api-access-vrrlx\") pod \"iptables-alerter-jznmz\" (UID: \"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d\") " pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143437 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a8de880-d4ae-479c-a1fa-24542a000e2d-host\") pod \"node-ca-5ch8f\" (UID: \"0a8de880-d4ae-479c-a1fa-24542a000e2d\") " pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-kubelet\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-cni-bin\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143545 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a8de880-d4ae-479c-a1fa-24542a000e2d-host\") pod \"node-ca-5ch8f\" (UID: \"0a8de880-d4ae-479c-a1fa-24542a000e2d\") " pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-tuned\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143596 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-cni-bin\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143597 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkkkk\" (UniqueName: \"kubernetes.io/projected/0a8de880-d4ae-479c-a1fa-24542a000e2d-kube-api-access-vkkkk\") pod \"node-ca-5ch8f\" (UID: \"0a8de880-d4ae-479c-a1fa-24542a000e2d\") " pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143635 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ab10076-672a-4497-b3a7-7748c94ec5c0-ovn-node-metrics-cert\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.144632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e6f3e76-1c4e-477c-8cbe-150e96f8b72d-agent-certs\") pod \"konnectivity-agent-9vrfp\" (UID: \"6e6f3e76-1c4e-477c-8cbe-150e96f8b72d\") " pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143683 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-os-release\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143709 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143731 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-os-release\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aef4695-ff40-4b36-8b91-09d435defed0-cni-binary-copy\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-multus-socket-dir-parent\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7qsn\" (UniqueName: \"kubernetes.io/projected/4f590fce-a040-4a88-899f-d493c1e482e9-kube-api-access-w7qsn\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143830 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ab10076-672a-4497-b3a7-7748c94ec5c0-env-overrides\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.143950 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-kubelet\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144085 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-cnibin\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-device-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-run-systemd\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144173 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144221 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f590fce-a040-4a88-899f-d493c1e482e9-device-dir\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144262 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-var-lib-kubelet\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144264 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ab10076-672a-4497-b3a7-7748c94ec5c0-env-overrides\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.145553 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144300 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-run-systemd\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144351 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42642d3c-a017-4969-8415-87c24243cf65-tmp-dir\") pod \"node-resolver-kqr4w\" (UID: \"42642d3c-a017-4969-8415-87c24243cf65\") " pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-run-k8s-cni-cncf-io\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144419 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-var-lib-cni-bin\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144469 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-etc-kubernetes\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144505 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-var-lib-kubelet\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144605 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-sys\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-host\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144670 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7dbq\" (UniqueName: \"kubernetes.io/projected/80ac223f-ed41-475c-a79a-1e830b4d20d1-kube-api-access-l7dbq\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144676 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144694 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-multus-cni-dir\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144727 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-run-netns\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-log-socket\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144789 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-cni-netd\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r94dt\" (UniqueName: \"kubernetes.io/projected/6ab10076-672a-4497-b3a7-7748c94ec5c0-kube-api-access-r94dt\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.146398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144833 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.147176 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144877 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-host-cni-netd\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.147176 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.144839 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ab10076-672a-4497-b3a7-7748c94ec5c0-log-socket\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.147482 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.147464 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e6f3e76-1c4e-477c-8cbe-150e96f8b72d-agent-certs\") pod \"konnectivity-agent-9vrfp\" (UID: \"6e6f3e76-1c4e-477c-8cbe-150e96f8b72d\") " pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:25.147855 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.147836 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ab10076-672a-4497-b3a7-7748c94ec5c0-ovn-node-metrics-cert\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.151437 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.151376 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkkkk\" (UniqueName: \"kubernetes.io/projected/0a8de880-d4ae-479c-a1fa-24542a000e2d-kube-api-access-vkkkk\") pod \"node-ca-5ch8f\" (UID: \"0a8de880-d4ae-479c-a1fa-24542a000e2d\") " pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.152360 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.152344 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r94dt\" (UniqueName: \"kubernetes.io/projected/6ab10076-672a-4497-b3a7-7748c94ec5c0-kube-api-access-r94dt\") pod \"ovnkube-node-xrs4m\" (UID: \"6ab10076-672a-4497-b3a7-7748c94ec5c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.152491 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.152472 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7qsn\" (UniqueName: \"kubernetes.io/projected/4f590fce-a040-4a88-899f-d493c1e482e9-kube-api-access-w7qsn\") pod \"aws-ebs-csi-driver-node-m4jv8\" (UID: \"4f590fce-a040-4a88-899f-d493c1e482e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.246645 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246598 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-sysctl-conf\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.246824 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246664 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c5f4cb9-150e-49a1-89e8-02a5cdf8819d-iptables-alerter-script\") pod \"iptables-alerter-jznmz\" (UID: \"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d\") " pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.246824 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246704 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrrlx\" (UniqueName: \"kubernetes.io/projected/5c5f4cb9-150e-49a1-89e8-02a5cdf8819d-kube-api-access-vrrlx\") pod \"iptables-alerter-jznmz\" (UID: \"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d\") " pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.246824 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.246824 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246763 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-tuned\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.246824 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-os-release\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.247093 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246864 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:25.247093 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246891 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-os-release\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.247093 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aef4695-ff40-4b36-8b91-09d435defed0-cni-binary-copy\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.247093 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.246977 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-multus-socket-dir-parent\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.247268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247153 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-os-release\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.247321 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247267 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-os-release\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.247321 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247296 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-sysctl-conf\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.247462 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247593 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-cnibin\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247630 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-var-lib-kubelet\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247664 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42642d3c-a017-4969-8415-87c24243cf65-tmp-dir\") pod \"node-resolver-kqr4w\" (UID: \"42642d3c-a017-4969-8415-87c24243cf65\") " pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-run-k8s-cni-cncf-io\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247726 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-var-lib-cni-bin\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247759 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-etc-kubernetes\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247799 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8aef4695-ff40-4b36-8b91-09d435defed0-cni-binary-copy\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-var-lib-kubelet\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247830 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c5f4cb9-150e-49a1-89e8-02a5cdf8819d-iptables-alerter-script\") pod \"iptables-alerter-jznmz\" (UID: \"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d\") " pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247909 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-run-k8s-cni-cncf-io\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.247989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-sys\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248118 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-host\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248149 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-host\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248156 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7dbq\" (UniqueName: \"kubernetes.io/projected/80ac223f-ed41-475c-a79a-1e830b4d20d1-kube-api-access-l7dbq\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.248609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248195 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-multus-cni-dir\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248222 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-run-netns\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248261 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.248294 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs podName:f78774be-c7f7-43ae-a745-08394c8732b1 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:25.748265072 +0000 UTC m=+3.090424404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs") pod "network-metrics-daemon-t2sqf" (UID: "f78774be-c7f7-43ae-a745-08394c8732b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248300 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248335 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v7rn\" (UniqueName: \"kubernetes.io/projected/42642d3c-a017-4969-8415-87c24243cf65-kube-api-access-4v7rn\") pod \"node-resolver-kqr4w\" (UID: \"42642d3c-a017-4969-8415-87c24243cf65\") " pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248386 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248398 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-multus-cni-dir\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248375 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-var-lib-cni-multus\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248451 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-var-lib-cni-multus\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248458 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-cnibin\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248474 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-var-lib-cni-bin\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248513 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-var-lib-kubelet\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248534 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-var-lib-kubelet\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248557 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-etc-kubernetes\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248619 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-sys\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249137 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.249465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.248675 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-run-netns\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249200 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42642d3c-a017-4969-8415-87c24243cf65-tmp-dir\") pod \"node-resolver-kqr4w\" (UID: \"42642d3c-a017-4969-8415-87c24243cf65\") " pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-multus-conf-dir\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-system-cni-dir\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249500 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76mnw\" (UniqueName: \"kubernetes.io/projected/f78774be-c7f7-43ae-a745-08394c8732b1-kube-api-access-76mnw\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249524 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-kubernetes\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249572 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-system-cni-dir\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249634 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-system-cni-dir\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249654 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-kubernetes\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249688 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-cnibin\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjlbb\" (UniqueName: \"kubernetes.io/projected/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-kube-api-access-tjlbb\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249724 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-system-cni-dir\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249241 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-multus-socket-dir-parent\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249348 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-multus-conf-dir\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249845 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-cnibin\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249877 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-hostroot\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249902 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c5f4cb9-150e-49a1-89e8-02a5cdf8819d-host-slash\") pod \"iptables-alerter-jznmz\" (UID: \"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d\") " pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-lib-modules\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250224 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.249970 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42642d3c-a017-4969-8415-87c24243cf65-hosts-file\") pod \"node-resolver-kqr4w\" (UID: \"42642d3c-a017-4969-8415-87c24243cf65\") " pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-modprobe-d\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250031 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-sysconfig\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-systemd\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250071 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80ac223f-ed41-475c-a79a-1e830b4d20d1-tmp\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250092 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aef4695-ff40-4b36-8b91-09d435defed0-multus-daemon-config\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250117 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-run\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7s8n\" (UniqueName: \"kubernetes.io/projected/8aef4695-ff40-4b36-8b91-09d435defed0-kube-api-access-m7s8n\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250171 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-cni-binary-copy\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250192 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-hostroot\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250194 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-run-multus-certs\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250229 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-sysctl-d\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250233 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8aef4695-ff40-4b36-8b91-09d435defed0-host-run-multus-certs\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250291 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-systemd\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250416 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-lib-modules\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250449 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-tuned\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250453 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-modprobe-d\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250475 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42642d3c-a017-4969-8415-87c24243cf65-hosts-file\") pod \"node-resolver-kqr4w\" (UID: \"42642d3c-a017-4969-8415-87c24243cf65\") " pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.250999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250535 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-run\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.251604 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250588 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-sysconfig\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.251604 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250616 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/80ac223f-ed41-475c-a79a-1e830b4d20d1-etc-sysctl-d\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.251604 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250666 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c5f4cb9-150e-49a1-89e8-02a5cdf8819d-host-slash\") pod \"iptables-alerter-jznmz\" (UID: \"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d\") " pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.251604 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.250904 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8aef4695-ff40-4b36-8b91-09d435defed0-multus-daemon-config\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.251604 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.251087 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-cni-binary-copy\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.252297 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.252278 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80ac223f-ed41-475c-a79a-1e830b4d20d1-tmp\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.255279 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.255260 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrrlx\" (UniqueName: \"kubernetes.io/projected/5c5f4cb9-150e-49a1-89e8-02a5cdf8819d-kube-api-access-vrrlx\") pod \"iptables-alerter-jznmz\" (UID: \"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d\") " pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.257005 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.256825 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:25.257005 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.256853 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:25.257005 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.256867 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gjczc for pod openshift-network-diagnostics/network-check-target-mp4jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:25.257005 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.256949 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc podName:23ac9a6a-7d2d-4707-b3b9-8092af22fa23 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:25.756914243 +0000 UTC m=+3.099073586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gjczc" (UniqueName: "kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc") pod "network-check-target-mp4jl" (UID: "23ac9a6a-7d2d-4707-b3b9-8092af22fa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:25.258387 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.258338 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76mnw\" (UniqueName: \"kubernetes.io/projected/f78774be-c7f7-43ae-a745-08394c8732b1-kube-api-access-76mnw\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:25.258542 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.258519 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7dbq\" (UniqueName: \"kubernetes.io/projected/80ac223f-ed41-475c-a79a-1e830b4d20d1-kube-api-access-l7dbq\") pod \"tuned-zpwvd\" (UID: \"80ac223f-ed41-475c-a79a-1e830b4d20d1\") " pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.258542 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.258534 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjlbb\" (UniqueName: \"kubernetes.io/projected/3bc75559-78ce-4b71-9a58-aeb5a07a5f33-kube-api-access-tjlbb\") pod \"multus-additional-cni-plugins-bwr67\" (UID: \"3bc75559-78ce-4b71-9a58-aeb5a07a5f33\") " pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.259936 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.259873 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" event={"ID":"0d66673e539a82e82550c56d52df9dc8","Type":"ContainerStarted","Data":"c72902f9602a92c2c5d858e91772015815e95d038fd34afebe1031b0bfe67941"} Jul 28 17:09:25.260259 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.260239 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v7rn\" (UniqueName: \"kubernetes.io/projected/42642d3c-a017-4969-8415-87c24243cf65-kube-api-access-4v7rn\") pod \"node-resolver-kqr4w\" (UID: \"42642d3c-a017-4969-8415-87c24243cf65\") " pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.261203 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.261180 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7s8n\" (UniqueName: \"kubernetes.io/projected/8aef4695-ff40-4b36-8b91-09d435defed0-kube-api-access-m7s8n\") pod \"multus-99s7f\" (UID: \"8aef4695-ff40-4b36-8b91-09d435defed0\") " pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.261301 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.261274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" event={"ID":"077a024c76d4b2dd7ce11113e9a0b5c1","Type":"ContainerStarted","Data":"c18b570c754625e000b4d5c641700b9fad604f56b06c6e8b5fdb9e9d7960b967"} Jul 28 17:09:25.331615 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.331585 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" Jul 28 17:09:25.337891 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.337868 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5ch8f" Jul 28 17:09:25.342869 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:25.342842 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f590fce_a040_4a88_899f_d493c1e482e9.slice/crio-9878512a9e2d66fa4df16d413a766d7e973d97567a7fc906d9f11a7d56a9f915 WatchSource:0}: Error finding container 9878512a9e2d66fa4df16d413a766d7e973d97567a7fc906d9f11a7d56a9f915: Status 404 returned error can't find the container with id 9878512a9e2d66fa4df16d413a766d7e973d97567a7fc906d9f11a7d56a9f915 Jul 28 17:09:25.344706 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.344581 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:25.348138 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:25.348105 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8de880_d4ae_479c_a1fa_24542a000e2d.slice/crio-7b09a62a1f4c8b6ca44310e4ea76601b54040c45a565be514c98f03cefd1ea3b WatchSource:0}: Error finding container 7b09a62a1f4c8b6ca44310e4ea76601b54040c45a565be514c98f03cefd1ea3b: Status 404 returned error can't find the container with id 7b09a62a1f4c8b6ca44310e4ea76601b54040c45a565be514c98f03cefd1ea3b Jul 28 17:09:25.351827 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.351804 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:25.355242 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:25.355222 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab10076_672a_4497_b3a7_7748c94ec5c0.slice/crio-100060eb563053ea9315319d5a6dcace3ad80789a5b4c2524a804a366d77d13d WatchSource:0}: Error finding container 100060eb563053ea9315319d5a6dcace3ad80789a5b4c2524a804a366d77d13d: Status 404 returned error can't find the container with id 100060eb563053ea9315319d5a6dcace3ad80789a5b4c2524a804a366d77d13d Jul 28 17:09:25.360435 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.360419 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bwr67" Jul 28 17:09:25.361375 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:25.361351 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6f3e76_1c4e_477c_8cbe_150e96f8b72d.slice/crio-dce1cdf1cd331f1bfa2b35b0eba9b52189575dcff5c3ebfc586bfa947a9cfad0 WatchSource:0}: Error finding container dce1cdf1cd331f1bfa2b35b0eba9b52189575dcff5c3ebfc586bfa947a9cfad0: Status 404 returned error can't find the container with id dce1cdf1cd331f1bfa2b35b0eba9b52189575dcff5c3ebfc586bfa947a9cfad0 Jul 28 17:09:25.365232 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.365211 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-99s7f" Jul 28 17:09:25.370538 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:25.370511 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc75559_78ce_4b71_9a58_aeb5a07a5f33.slice/crio-ba28bad07e149c8d1b51a747e42d570c62c55da7f8360804a23414795cf20abb WatchSource:0}: Error finding container ba28bad07e149c8d1b51a747e42d570c62c55da7f8360804a23414795cf20abb: Status 404 returned error can't find the container with id ba28bad07e149c8d1b51a747e42d570c62c55da7f8360804a23414795cf20abb Jul 28 17:09:25.372533 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.372514 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jznmz" Jul 28 17:09:25.375218 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:25.375195 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aef4695_ff40_4b36_8b91_09d435defed0.slice/crio-b31a52b9f0ec18a77323da20028db5de337b7025c082e067a78fa2b146eeece7 WatchSource:0}: Error finding container b31a52b9f0ec18a77323da20028db5de337b7025c082e067a78fa2b146eeece7: Status 404 returned error can't find the container with id b31a52b9f0ec18a77323da20028db5de337b7025c082e067a78fa2b146eeece7 Jul 28 17:09:25.379527 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.379508 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" Jul 28 17:09:25.381383 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:25.381356 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5f4cb9_150e_49a1_89e8_02a5cdf8819d.slice/crio-f0f45d18f8c31512bb6d17f78b12663c39e4ee2c36a7830dd4880a6864fa828f WatchSource:0}: Error finding container f0f45d18f8c31512bb6d17f78b12663c39e4ee2c36a7830dd4880a6864fa828f: Status 404 returned error can't find the container with id f0f45d18f8c31512bb6d17f78b12663c39e4ee2c36a7830dd4880a6864fa828f Jul 28 17:09:25.384508 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.384489 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kqr4w" Jul 28 17:09:25.389596 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:25.389577 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ac223f_ed41_475c_a79a_1e830b4d20d1.slice/crio-cb05b1aac9974b84fda6718b2f706a193fb7a18a937a1e64629c1f2e9771c046 WatchSource:0}: Error finding container cb05b1aac9974b84fda6718b2f706a193fb7a18a937a1e64629c1f2e9771c046: Status 404 returned error can't find the container with id cb05b1aac9974b84fda6718b2f706a193fb7a18a937a1e64629c1f2e9771c046 Jul 28 17:09:25.395071 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:25.395049 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42642d3c_a017_4969_8415_87c24243cf65.slice/crio-68b023ae737f7b37bcc0fe1e9545b26aa72d40189c5e7abc5db226dd078904bd WatchSource:0}: Error finding container 68b023ae737f7b37bcc0fe1e9545b26aa72d40189c5e7abc5db226dd078904bd: Status 404 returned error can't find the container with id 68b023ae737f7b37bcc0fe1e9545b26aa72d40189c5e7abc5db226dd078904bd Jul 28 17:09:25.492689 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.492662 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:25.653035 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.652952 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:25.653203 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.653115 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:25.653203 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.653201 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret podName:1532bb2e-4650-4582-aa75-6714e5c29108 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:26.653171831 +0000 UTC m=+3.995331176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret") pod "global-pull-secret-syncer-jk4l4" (UID: "1532bb2e-4650-4582-aa75-6714e5c29108") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:25.754134 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.754102 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:25.754289 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.754239 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:25.754325 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.754300 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs podName:f78774be-c7f7-43ae-a745-08394c8732b1 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:26.754283972 +0000 UTC m=+4.096443304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs") pod "network-metrics-daemon-t2sqf" (UID: "f78774be-c7f7-43ae-a745-08394c8732b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:25.855857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:25.855224 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:25.855857 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.855385 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:25.855857 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.855411 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:25.855857 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.855424 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gjczc for pod openshift-network-diagnostics/network-check-target-mp4jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:25.855857 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:25.855481 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc podName:23ac9a6a-7d2d-4707-b3b9-8092af22fa23 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:26.855463934 +0000 UTC m=+4.197623280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjczc" (UniqueName: "kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc") pod "network-check-target-mp4jl" (UID: "23ac9a6a-7d2d-4707-b3b9-8092af22fa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:26.034275 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.034184 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:26.080243 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.080200 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:04:25 +0000 UTC" deadline="2028-03-29 22:11:34.993069811 +0000 UTC" Jul 28 17:09:26.080243 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.080242 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14645h2m8.912832261s" Jul 28 17:09:26.255475 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.255432 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:26.255605 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.255561 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:26.256000 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.255980 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:26.256096 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.256081 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:26.276910 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.276881 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kqr4w" event={"ID":"42642d3c-a017-4969-8415-87c24243cf65","Type":"ContainerStarted","Data":"68b023ae737f7b37bcc0fe1e9545b26aa72d40189c5e7abc5db226dd078904bd"} Jul 28 17:09:26.279359 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.279328 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-99s7f" event={"ID":"8aef4695-ff40-4b36-8b91-09d435defed0","Type":"ContainerStarted","Data":"b31a52b9f0ec18a77323da20028db5de337b7025c082e067a78fa2b146eeece7"} Jul 28 17:09:26.284560 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.284491 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9vrfp" event={"ID":"6e6f3e76-1c4e-477c-8cbe-150e96f8b72d","Type":"ContainerStarted","Data":"dce1cdf1cd331f1bfa2b35b0eba9b52189575dcff5c3ebfc586bfa947a9cfad0"} Jul 28 17:09:26.298736 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.298713 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5ch8f" event={"ID":"0a8de880-d4ae-479c-a1fa-24542a000e2d","Type":"ContainerStarted","Data":"7b09a62a1f4c8b6ca44310e4ea76601b54040c45a565be514c98f03cefd1ea3b"} Jul 28 17:09:26.305844 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.305773 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" event={"ID":"4f590fce-a040-4a88-899f-d493c1e482e9","Type":"ContainerStarted","Data":"9878512a9e2d66fa4df16d413a766d7e973d97567a7fc906d9f11a7d56a9f915"} Jul 28 17:09:26.315999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.315972 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" event={"ID":"80ac223f-ed41-475c-a79a-1e830b4d20d1","Type":"ContainerStarted","Data":"cb05b1aac9974b84fda6718b2f706a193fb7a18a937a1e64629c1f2e9771c046"} Jul 28 17:09:26.319145 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.319115 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jznmz" event={"ID":"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d","Type":"ContainerStarted","Data":"f0f45d18f8c31512bb6d17f78b12663c39e4ee2c36a7830dd4880a6864fa828f"} Jul 28 17:09:26.322786 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.322708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerStarted","Data":"ba28bad07e149c8d1b51a747e42d570c62c55da7f8360804a23414795cf20abb"} Jul 28 17:09:26.326935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.326878 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" event={"ID":"6ab10076-672a-4497-b3a7-7748c94ec5c0","Type":"ContainerStarted","Data":"100060eb563053ea9315319d5a6dcace3ad80789a5b4c2524a804a366d77d13d"} Jul 28 17:09:26.667093 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.666671 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:26.667093 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.666943 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:26.667093 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.667025 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret podName:1532bb2e-4650-4582-aa75-6714e5c29108 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:28.667004778 +0000 UTC m=+6.009164113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret") pod "global-pull-secret-syncer-jk4l4" (UID: "1532bb2e-4650-4582-aa75-6714e5c29108") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:26.768113 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.768077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:26.768304 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.768288 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:26.768371 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.768357 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs podName:f78774be-c7f7-43ae-a745-08394c8732b1 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:28.768337888 +0000 UTC m=+6.110497223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs") pod "network-metrics-daemon-t2sqf" (UID: "f78774be-c7f7-43ae-a745-08394c8732b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:26.869765 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:26.869087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:26.869765 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.869281 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:26.869765 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.869302 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:26.869765 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.869314 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gjczc for pod openshift-network-diagnostics/network-check-target-mp4jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:26.869765 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:26.869379 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc podName:23ac9a6a-7d2d-4707-b3b9-8092af22fa23 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:28.869361025 +0000 UTC m=+6.211520370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjczc" (UniqueName: "kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc") pod "network-check-target-mp4jl" (UID: "23ac9a6a-7d2d-4707-b3b9-8092af22fa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:27.080492 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:27.080385 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:04:25 +0000 UTC" deadline="2028-02-10 20:45:22.861151942 +0000 UTC" Jul 28 17:09:27.080492 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:27.080421 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13491h35m55.780735377s" Jul 28 17:09:27.285164 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:27.263805 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:27.285164 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:27.263972 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:27.349701 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:27.349478 2582 generic.go:356] "Generic (PLEG): container finished" podID="077a024c76d4b2dd7ce11113e9a0b5c1" containerID="dec8360bd2b549f178e0dcc5592eb8f77ace74e8c0250fac369a7222ec1a682c" exitCode=0 Jul 28 17:09:27.349701 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:27.349538 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" event={"ID":"077a024c76d4b2dd7ce11113e9a0b5c1","Type":"ContainerDied","Data":"dec8360bd2b549f178e0dcc5592eb8f77ace74e8c0250fac369a7222ec1a682c"} Jul 28 17:09:28.255466 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:28.254796 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:28.255466 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.254919 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:28.255466 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:28.255319 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:28.255466 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.255415 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:28.695798 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:28.695713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:28.695970 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.695911 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:28.696049 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.695991 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret podName:1532bb2e-4650-4582-aa75-6714e5c29108 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:32.695971311 +0000 UTC m=+10.038130641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret") pod "global-pull-secret-syncer-jk4l4" (UID: "1532bb2e-4650-4582-aa75-6714e5c29108") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:28.796874 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:28.796842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:28.797060 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.797033 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:28.797159 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.797145 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs podName:f78774be-c7f7-43ae-a745-08394c8732b1 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:32.797123769 +0000 UTC m=+10.139283101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs") pod "network-metrics-daemon-t2sqf" (UID: "f78774be-c7f7-43ae-a745-08394c8732b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:28.898905 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:28.898208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:28.898905 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.898439 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:28.898905 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.898464 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:28.898905 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.898478 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gjczc for pod openshift-network-diagnostics/network-check-target-mp4jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:28.898905 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:28.898533 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc podName:23ac9a6a-7d2d-4707-b3b9-8092af22fa23 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:32.898516746 +0000 UTC m=+10.240676074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjczc" (UniqueName: "kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc") pod "network-check-target-mp4jl" (UID: "23ac9a6a-7d2d-4707-b3b9-8092af22fa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:29.257130 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:29.256197 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:29.257130 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:29.256346 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:30.255105 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:30.255067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:30.255289 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:30.255197 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:30.255537 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:30.255350 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:30.255537 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:30.255468 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:31.254722 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:31.254684 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:31.255203 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:31.254835 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:32.255121 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:32.255084 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:32.255560 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:32.255121 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:32.255560 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.255211 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:32.255560 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.255350 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:32.732842 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:32.732764 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:32.733028 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.732908 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:32.733028 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.733003 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret podName:1532bb2e-4650-4582-aa75-6714e5c29108 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:40.732983332 +0000 UTC m=+18.075142679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret") pod "global-pull-secret-syncer-jk4l4" (UID: "1532bb2e-4650-4582-aa75-6714e5c29108") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:32.833471 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:32.833435 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:32.833635 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.833607 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:32.833719 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.833685 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs podName:f78774be-c7f7-43ae-a745-08394c8732b1 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:40.833663727 +0000 UTC m=+18.175823059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs") pod "network-metrics-daemon-t2sqf" (UID: "f78774be-c7f7-43ae-a745-08394c8732b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:32.934782 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:32.934748 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:32.934963 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.934948 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:32.935011 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.934974 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:32.935011 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.934987 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gjczc for pod openshift-network-diagnostics/network-check-target-mp4jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:32.935113 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:32.935049 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc podName:23ac9a6a-7d2d-4707-b3b9-8092af22fa23 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:40.93503105 +0000 UTC m=+18.277190400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjczc" (UniqueName: "kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc") pod "network-check-target-mp4jl" (UID: "23ac9a6a-7d2d-4707-b3b9-8092af22fa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:33.258068 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:33.257558 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:33.258068 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:33.257691 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:34.254936 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:34.254805 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:34.254936 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:34.254905 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:34.255374 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:34.254805 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:34.255374 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:34.255337 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:35.254814 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:35.254773 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:35.255222 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:35.254942 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:36.255163 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:36.255124 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:36.255163 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:36.255148 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:36.255622 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:36.255257 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:36.255622 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:36.255394 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:37.255385 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:37.255358 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:37.255698 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:37.255478 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:38.254630 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:38.254591 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:38.254840 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:38.254637 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:38.254840 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:38.254727 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:38.254972 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:38.254869 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:39.255013 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:39.254971 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:39.255425 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:39.255109 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:40.255310 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:40.255258 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:40.255815 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.255422 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:40.255815 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:40.255482 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:40.255815 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.255592 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:40.793692 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:40.793647 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:40.793951 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.793805 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:40.793951 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.793888 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret podName:1532bb2e-4650-4582-aa75-6714e5c29108 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:56.793866751 +0000 UTC m=+34.136026094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret") pod "global-pull-secret-syncer-jk4l4" (UID: "1532bb2e-4650-4582-aa75-6714e5c29108") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:40.894218 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:40.894184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:40.894413 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.894302 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:40.894413 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.894368 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs podName:f78774be-c7f7-43ae-a745-08394c8732b1 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:56.894352347 +0000 UTC m=+34.236511676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs") pod "network-metrics-daemon-t2sqf" (UID: "f78774be-c7f7-43ae-a745-08394c8732b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:40.994534 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:40.994504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:40.994707 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.994619 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:40.994707 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.994634 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:40.994707 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.994642 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gjczc for pod openshift-network-diagnostics/network-check-target-mp4jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:40.994707 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:40.994707 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc podName:23ac9a6a-7d2d-4707-b3b9-8092af22fa23 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:56.994692048 +0000 UTC m=+34.336851398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjczc" (UniqueName: "kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc") pod "network-check-target-mp4jl" (UID: "23ac9a6a-7d2d-4707-b3b9-8092af22fa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:41.254747 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:41.254715 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:41.254952 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:41.254830 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:42.254803 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:42.254764 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:42.255255 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:42.254776 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:42.255255 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:42.254906 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:42.255255 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:42.254993 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:43.255874 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:43.255837 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:43.256366 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:43.255990 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:44.255420 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:44.255380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:44.255612 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:44.255390 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:44.255612 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:44.255508 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:44.255728 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:44.255610 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:45.255138 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.254655 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:45.255138 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:45.254792 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:45.397789 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.397504 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerStarted","Data":"bb3fd8fe6de5ddd42adeb7bb1e968e5ac05a31da4302943eefc3b1c50b1b91a4"} Jul 28 17:09:45.400393 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.400365 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" event={"ID":"6ab10076-672a-4497-b3a7-7748c94ec5c0","Type":"ContainerStarted","Data":"7afc5738af0573af5d59ba528a67c9fdd41cd556c856e8d59f1a1772ba1e5269"} Jul 28 17:09:45.410759 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.410731 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-99s7f" event={"ID":"8aef4695-ff40-4b36-8b91-09d435defed0","Type":"ContainerStarted","Data":"c46a9870cd037e2c8d0a4a8e80cb52a0cf59f3520aaff439739797966e787124"} Jul 28 17:09:45.413222 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.413188 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9vrfp" event={"ID":"6e6f3e76-1c4e-477c-8cbe-150e96f8b72d","Type":"ContainerStarted","Data":"f9eecd446578d7acd8907809a3afe9f0d720a7c6d060570f7c3cd56bb8ff6500"} Jul 28 17:09:45.415881 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.415742 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5ch8f" event={"ID":"0a8de880-d4ae-479c-a1fa-24542a000e2d","Type":"ContainerStarted","Data":"249d2f3d7935bb6e4e36b236e22086e285b6afdd77175ca61d25aebc036d6cd7"} Jul 28 17:09:45.418309 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.418284 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" event={"ID":"4f590fce-a040-4a88-899f-d493c1e482e9","Type":"ContainerStarted","Data":"dd5e448c6d8731179f5576ad9f34bdbb07e35d4dde1747f615360a3527917113"} Jul 28 17:09:45.420087 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.420068 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" event={"ID":"0d66673e539a82e82550c56d52df9dc8","Type":"ContainerStarted","Data":"f16e772cc501912e27d5d628a73d1cf0fd524ba8fd3c569110b23c0e34fe22ac"} Jul 28 17:09:45.422513 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.422434 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" event={"ID":"077a024c76d4b2dd7ce11113e9a0b5c1","Type":"ContainerStarted","Data":"52dd65bc69451091769928f9b3e98a63d8ea44c8c7fdf1e7311287e3131d867b"} Jul 28 17:09:45.425193 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.425169 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" event={"ID":"80ac223f-ed41-475c-a79a-1e830b4d20d1","Type":"ContainerStarted","Data":"fba38b142804f702627f4ea22db5b18c379618eccbbbce6201458ddc5e4aef77"} Jul 28 17:09:45.436801 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.436756 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9vrfp" podStartSLOduration=2.629905608 podStartE2EDuration="22.436741284s" totalImagesPullingTime="19.806835676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:45.436304311 +0000 UTC m=+22.778463675" watchObservedRunningTime="2026-07-28 17:09:45.436741284 +0000 UTC m=+22.778900632" Jul 28 17:09:45.454360 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.454315 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-99s7f" podStartSLOduration=2.5969485260000003 podStartE2EDuration="22.454299084s" totalImagesPullingTime="19.857350558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:45.453823587 +0000 UTC m=+22.795982951" watchObservedRunningTime="2026-07-28 17:09:45.454299084 +0000 UTC m=+22.796458435" Jul 28 17:09:45.469003 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.468815 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kqr4w" podStartSLOduration=2.731366656 podStartE2EDuration="22.468800998s" totalImagesPullingTime="19.737434342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:45.468421789 +0000 UTC m=+22.810581139" watchObservedRunningTime="2026-07-28 17:09:45.468800998 +0000 UTC m=+22.810960349" Jul 28 17:09:45.498751 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.498709 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5ch8f" podStartSLOduration=2.715669072 podStartE2EDuration="22.498694259s" totalImagesPullingTime="19.783025187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:45.498441843 +0000 UTC m=+22.840601193" watchObservedRunningTime="2026-07-28 17:09:45.498694259 +0000 UTC m=+22.840853610" Jul 28 17:09:45.499137 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.499112 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-156.ec2.internal" podStartSLOduration=21.499103011 podStartE2EDuration="21.499103011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:45.48308728 +0000 UTC m=+22.825246633" watchObservedRunningTime="2026-07-28 17:09:45.499103011 +0000 UTC m=+22.841262365" Jul 28 17:09:45.519073 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.519028 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zpwvd" podStartSLOduration=2.739243885 podStartE2EDuration="22.519012386s" totalImagesPullingTime="19.779768501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:45.518730594 +0000 UTC m=+22.860889945" watchObservedRunningTime="2026-07-28 17:09:45.519012386 +0000 UTC m=+22.861171737" Jul 28 17:09:45.538063 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:45.538021 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-156.ec2.internal" podStartSLOduration=21.538003991 podStartE2EDuration="21.538003991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:45.537889699 +0000 UTC m=+22.880049050" watchObservedRunningTime="2026-07-28 17:09:45.538003991 +0000 UTC m=+22.880163343" Jul 28 17:09:46.254592 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.254565 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:46.254705 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.254616 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:46.254705 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:46.254680 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:46.254790 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:46.254778 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:46.429853 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.429812 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" event={"ID":"6ab10076-672a-4497-b3a7-7748c94ec5c0","Type":"ContainerStarted","Data":"b69d86bf6fe68a20f3b871f7e0db6d80d739e1cc5313e7e3b5a13c8698b1ef8e"} Jul 28 17:09:46.430609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.429886 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" event={"ID":"6ab10076-672a-4497-b3a7-7748c94ec5c0","Type":"ContainerStarted","Data":"f72774a69232e843f53f4c7f35e8f17cb52f70df00c7892209864d67829214dc"} Jul 28 17:09:46.430609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.429977 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" event={"ID":"6ab10076-672a-4497-b3a7-7748c94ec5c0","Type":"ContainerStarted","Data":"e621328806a7cf19290ebcdd9ddf8de5fcabb38d7667018d59272e6e15c0ee7a"} Jul 28 17:09:46.430609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.430029 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" event={"ID":"6ab10076-672a-4497-b3a7-7748c94ec5c0","Type":"ContainerStarted","Data":"4304be2264ce6cd61d22eddc1782aea6bbcf734c688dfd48af02650cd793ae1d"} Jul 28 17:09:46.430609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.430070 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" event={"ID":"6ab10076-672a-4497-b3a7-7748c94ec5c0","Type":"ContainerStarted","Data":"3f81d296584f53b555fc440dba07af7566d127686e5c0719217e0befc8a60fb8"} Jul 28 17:09:46.431230 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.431207 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kqr4w" event={"ID":"42642d3c-a017-4969-8415-87c24243cf65","Type":"ContainerStarted","Data":"3a532bc62a717aaf21924f9d70e0fbd004886529898b7fd3cc79e3f628c88425"} Jul 28 17:09:46.432530 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.432500 2582 generic.go:356] "Generic (PLEG): container finished" podID="3bc75559-78ce-4b71-9a58-aeb5a07a5f33" containerID="bb3fd8fe6de5ddd42adeb7bb1e968e5ac05a31da4302943eefc3b1c50b1b91a4" exitCode=0 Jul 28 17:09:46.432627 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.432607 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerDied","Data":"bb3fd8fe6de5ddd42adeb7bb1e968e5ac05a31da4302943eefc3b1c50b1b91a4"} Jul 28 17:09:46.664890 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:46.664857 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 17:09:47.107975 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:47.107868 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:09:46.664883664Z","UUID":"e8878eb5-dd0b-4dc8-ab9f-2a845aeb0803","Handler":null,"Name":"","Endpoint":""} Jul 28 17:09:47.109558 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:47.109535 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 17:09:47.109687 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:47.109579 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 17:09:47.254683 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:47.254648 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:47.254978 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:47.254785 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:47.436734 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:47.436645 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jznmz" event={"ID":"5c5f4cb9-150e-49a1-89e8-02a5cdf8819d","Type":"ContainerStarted","Data":"218770a723f0558bbf68a24ac9f99dac8fb119f53264e8f8785131ee366b221f"} Jul 28 17:09:47.439273 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:47.439242 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" event={"ID":"4f590fce-a040-4a88-899f-d493c1e482e9","Type":"ContainerStarted","Data":"0a0efcf94487dbbfe0bca8603cd31be99f56189b067fca788da942eb569fafdc"} Jul 28 17:09:47.452591 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:47.452518 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jznmz" podStartSLOduration=4.664653369 podStartE2EDuration="24.45250102s" totalImagesPullingTime="19.787847651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:47.451680657 +0000 UTC m=+24.793840008" watchObservedRunningTime="2026-07-28 17:09:47.45250102 +0000 UTC m=+24.794660370" Jul 28 17:09:47.678069 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:47.678038 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:47.678691 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:47.678669 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:48.254639 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:48.254606 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:48.254946 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:48.254619 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:48.254946 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:48.254789 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:48.254946 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:48.254827 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:48.446219 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:48.446120 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" event={"ID":"6ab10076-672a-4497-b3a7-7748c94ec5c0","Type":"ContainerStarted","Data":"196b798d71b08ca6cfc421e39a75a05d69b06166fd0606e32a3ea6e5ecc8faab"} Jul 28 17:09:48.448361 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:48.448334 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" event={"ID":"4f590fce-a040-4a88-899f-d493c1e482e9","Type":"ContainerStarted","Data":"a87a5fc5ff8b3f860dbfe75ab244f25ae28881e95a43660d748c19600bfe155f"} Jul 28 17:09:48.448607 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:48.448578 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:48.449076 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:48.449044 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9vrfp" Jul 28 17:09:48.466814 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:48.466764 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4jv8" podStartSLOduration=3.411533292 podStartE2EDuration="25.46675148s" totalImagesPullingTime="22.055218188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:48.466168825 +0000 UTC m=+25.808328171" watchObservedRunningTime="2026-07-28 17:09:48.46675148 +0000 UTC m=+25.808910831" Jul 28 17:09:49.255258 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:49.255065 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:49.255435 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:49.255363 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:50.255442 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:50.255409 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:50.256023 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:50.255409 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:50.256023 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:50.255549 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:50.256023 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:50.255585 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:51.255755 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.255581 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:51.256375 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:51.255852 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:51.456011 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.455980 2582 generic.go:356] "Generic (PLEG): container finished" podID="3bc75559-78ce-4b71-9a58-aeb5a07a5f33" containerID="f764a272cf9bdbe2416619b3b0e8e93d7f698e42954d4af4fc87390bc5511d64" exitCode=0 Jul 28 17:09:51.456360 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.456064 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerDied","Data":"f764a272cf9bdbe2416619b3b0e8e93d7f698e42954d4af4fc87390bc5511d64"} Jul 28 17:09:51.459669 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.459648 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" event={"ID":"6ab10076-672a-4497-b3a7-7748c94ec5c0","Type":"ContainerStarted","Data":"86d8be606f4182111bc53632f2ccadd49f9e89d0b3bfd7939bc455456cf7a3c3"} Jul 28 17:09:51.460800 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.460769 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:51.463348 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.461059 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:51.463348 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.461164 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:51.476632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.476611 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:51.478067 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.478049 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:09:51.512300 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:51.512211 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" podStartSLOduration=8.632528934 podStartE2EDuration="28.512195552s" totalImagesPullingTime="19.879666618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:51.511165726 +0000 UTC m=+28.853325077" watchObservedRunningTime="2026-07-28 17:09:51.512195552 +0000 UTC m=+28.854354902" Jul 28 17:09:52.255312 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:52.255282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:52.255514 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:52.255282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:52.255514 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:52.255388 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:52.255514 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:52.255455 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:52.598465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:52.598228 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jk4l4"] Jul 28 17:09:52.598891 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:52.598563 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:52.598891 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:52.598669 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:52.599018 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:52.598982 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mp4jl"] Jul 28 17:09:52.599086 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:52.599072 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:52.599192 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:52.599168 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:52.612282 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:52.612261 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t2sqf"] Jul 28 17:09:52.612398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:52.612352 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:52.612449 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:52.612434 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:53.467368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:53.467331 2582 generic.go:356] "Generic (PLEG): container finished" podID="3bc75559-78ce-4b71-9a58-aeb5a07a5f33" containerID="12f6aef9e0de11c6245e3e748b920f5d1250ede66f1837ca716c6546a6e98832" exitCode=0 Jul 28 17:09:53.467565 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:53.467416 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerDied","Data":"12f6aef9e0de11c6245e3e748b920f5d1250ede66f1837ca716c6546a6e98832"} Jul 28 17:09:54.255426 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:54.255397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:54.255787 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:54.255457 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:54.255787 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:54.255397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:54.255787 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:54.255537 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:54.255787 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:54.255596 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:54.255787 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:54.255676 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:55.473139 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:55.473097 2582 generic.go:356] "Generic (PLEG): container finished" podID="3bc75559-78ce-4b71-9a58-aeb5a07a5f33" containerID="f171e1f48f6fb267d12511550ce2f23f642f522cb27803320d51c9f7be9f9724" exitCode=0 Jul 28 17:09:55.473649 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:55.473170 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerDied","Data":"f171e1f48f6fb267d12511550ce2f23f642f522cb27803320d51c9f7be9f9724"} Jul 28 17:09:56.254987 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:56.254934 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:56.254987 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:56.254952 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:56.255243 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:56.255051 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:56.255243 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:56.255068 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:56.255243 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:56.255156 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:56.255377 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:56.255263 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:56.814110 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:56.814077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:56.814634 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:56.814182 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:56.814634 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:56.814234 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret podName:1532bb2e-4650-4582-aa75-6714e5c29108 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:28.814219789 +0000 UTC m=+66.156379118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret") pod "global-pull-secret-syncer-jk4l4" (UID: "1532bb2e-4650-4582-aa75-6714e5c29108") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:56.914838 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:56.914740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:56.915043 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:56.914881 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:56.915043 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:56.914956 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs podName:f78774be-c7f7-43ae-a745-08394c8732b1 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:28.914939896 +0000 UTC m=+66.257099242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs") pod "network-metrics-daemon-t2sqf" (UID: "f78774be-c7f7-43ae-a745-08394c8732b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:57.016000 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:57.015971 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:57.016163 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:57.016110 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:57.016163 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:57.016126 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:57.016163 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:57.016135 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gjczc for pod openshift-network-diagnostics/network-check-target-mp4jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:57.016293 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:57.016193 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc podName:23ac9a6a-7d2d-4707-b3b9-8092af22fa23 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:29.016175711 +0000 UTC m=+66.358335040 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjczc" (UniqueName: "kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc") pod "network-check-target-mp4jl" (UID: "23ac9a6a-7d2d-4707-b3b9-8092af22fa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:57.553228 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:57.553173 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:09:57.661818 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:57.661787 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:09:57.762724 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:57.762688 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:09:58.255302 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.255216 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:09:58.255302 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.255254 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:09:58.255302 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.255255 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:09:58.255859 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:58.255358 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t2sqf" podUID="f78774be-c7f7-43ae-a745-08394c8732b1" Jul 28 17:09:58.255859 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:58.255432 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jk4l4" podUID="1532bb2e-4650-4582-aa75-6714e5c29108" Jul 28 17:09:58.255859 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:58.255514 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp4jl" podUID="23ac9a6a-7d2d-4707-b3b9-8092af22fa23" Jul 28 17:09:58.830874 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.830843 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-156.ec2.internal" event="NodeReady" Jul 28 17:09:58.831075 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.831008 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 17:09:58.865174 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.865141 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75df48b9c7-f9prp"] Jul 28 17:09:58.867624 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.867583 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:58.870149 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.870117 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 17:09:58.870250 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.870170 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 17:09:58.870250 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.870238 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6jkxz\"" Jul 28 17:09:58.870473 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.870440 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 17:09:58.876084 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.876057 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s424p"] Jul 28 17:09:58.877766 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.877748 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kjd8p"] Jul 28 17:09:58.877907 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.877885 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s424p" Jul 28 17:09:58.878034 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.877951 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 17:09:58.879858 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.879757 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:58.880435 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.880335 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 17:09:58.880435 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.880388 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 17:09:58.880592 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.880532 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 17:09:58.880592 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.880544 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q4trs\"" Jul 28 17:09:58.881911 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.881885 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8842r\"" Jul 28 17:09:58.882077 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.882061 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 17:09:58.882157 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.882101 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 17:09:58.883848 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.883828 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75df48b9c7-f9prp"] Jul 28 17:09:58.885752 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.885733 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s424p"] Jul 28 17:09:58.888906 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.888885 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kjd8p"] Jul 28 17:09:58.930189 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930146 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:58.930189 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930193 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdzt2\" (UniqueName: \"kubernetes.io/projected/c62ff42b-7e5d-4310-bb19-00a15b991f42-kube-api-access-qdzt2\") pod \"ingress-canary-s424p\" (UID: \"c62ff42b-7e5d-4310-bb19-00a15b991f42\") " pod="openshift-ingress-canary/ingress-canary-s424p" Jul 28 17:09:58.930427 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-installation-pull-secrets\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:58.930427 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930247 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:58.930427 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930271 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0467685-66af-4387-a17e-f30ecd28dcdf-tmp-dir\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:58.930427 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930305 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76mfd\" (UniqueName: \"kubernetes.io/projected/e0467685-66af-4387-a17e-f30ecd28dcdf-kube-api-access-76mfd\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:58.930427 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-trusted-ca\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:58.930427 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930338 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0467685-66af-4387-a17e-f30ecd28dcdf-config-volume\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:58.930427 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930363 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-bound-sa-token\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:58.930721 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-image-registry-private-configuration\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:58.930721 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930469 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/504ea955-8551-459b-8f9d-a39815fbd641-ca-trust-extracted\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:58.930721 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930499 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62ff42b-7e5d-4310-bb19-00a15b991f42-cert\") pod \"ingress-canary-s424p\" (UID: \"c62ff42b-7e5d-4310-bb19-00a15b991f42\") " pod="openshift-ingress-canary/ingress-canary-s424p" Jul 28 17:09:58.930721 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn49h\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-kube-api-access-dn49h\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:58.930721 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:58.930554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-registry-certificates\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.031617 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031582 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62ff42b-7e5d-4310-bb19-00a15b991f42-cert\") pod \"ingress-canary-s424p\" (UID: \"c62ff42b-7e5d-4310-bb19-00a15b991f42\") " pod="openshift-ingress-canary/ingress-canary-s424p" Jul 28 17:09:59.031617 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031617 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn49h\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-kube-api-access-dn49h\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031639 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-registry-certificates\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031716 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdzt2\" (UniqueName: \"kubernetes.io/projected/c62ff42b-7e5d-4310-bb19-00a15b991f42-kube-api-access-qdzt2\") pod \"ingress-canary-s424p\" (UID: \"c62ff42b-7e5d-4310-bb19-00a15b991f42\") " pod="openshift-ingress-canary/ingress-canary-s424p" Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-installation-pull-secrets\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031793 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0467685-66af-4387-a17e-f30ecd28dcdf-tmp-dir\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.031817 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76mfd\" (UniqueName: \"kubernetes.io/projected/e0467685-66af-4387-a17e-f30ecd28dcdf-kube-api-access-76mfd\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.031834 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75df48b9c7-f9prp: secret "image-registry-tls" not found Jul 28 17:09:59.031857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-trusted-ca\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.032369 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.031878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0467685-66af-4387-a17e-f30ecd28dcdf-config-volume\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:59.032369 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.031979 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls podName:504ea955-8551-459b-8f9d-a39815fbd641 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:59.531883312 +0000 UTC m=+36.874042660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls") pod "image-registry-75df48b9c7-f9prp" (UID: "504ea955-8551-459b-8f9d-a39815fbd641") : secret "image-registry-tls" not found Jul 28 17:09:59.032369 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.032014 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-bound-sa-token\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.032369 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.032053 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-image-registry-private-configuration\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.032369 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.032081 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/504ea955-8551-459b-8f9d-a39815fbd641-ca-trust-extracted\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.032369 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.032260 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0467685-66af-4387-a17e-f30ecd28dcdf-tmp-dir\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:59.032369 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.032312 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:09:59.032369 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.032365 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls podName:e0467685-66af-4387-a17e-f30ecd28dcdf nodeName:}" failed. No retries permitted until 2026-07-28 17:09:59.532351282 +0000 UTC m=+36.874510625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls") pod "dns-default-kjd8p" (UID: "e0467685-66af-4387-a17e-f30ecd28dcdf") : secret "dns-default-metrics-tls" not found Jul 28 17:09:59.032741 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.032409 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/504ea955-8551-459b-8f9d-a39815fbd641-ca-trust-extracted\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.032741 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.032527 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0467685-66af-4387-a17e-f30ecd28dcdf-config-volume\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:59.032741 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.032519 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-registry-certificates\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.033229 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.033208 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-trusted-ca\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.036673 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.036638 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-installation-pull-secrets\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.036776 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.036673 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-image-registry-private-configuration\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.036776 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.036703 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62ff42b-7e5d-4310-bb19-00a15b991f42-cert\") pod \"ingress-canary-s424p\" (UID: \"c62ff42b-7e5d-4310-bb19-00a15b991f42\") " pod="openshift-ingress-canary/ingress-canary-s424p" Jul 28 17:09:59.041841 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.041815 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdzt2\" (UniqueName: \"kubernetes.io/projected/c62ff42b-7e5d-4310-bb19-00a15b991f42-kube-api-access-qdzt2\") pod \"ingress-canary-s424p\" (UID: \"c62ff42b-7e5d-4310-bb19-00a15b991f42\") " pod="openshift-ingress-canary/ingress-canary-s424p" Jul 28 17:09:59.042114 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.042078 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76mfd\" (UniqueName: \"kubernetes.io/projected/e0467685-66af-4387-a17e-f30ecd28dcdf-kube-api-access-76mfd\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:59.042243 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.042130 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-bound-sa-token\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.042503 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.042483 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn49h\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-kube-api-access-dn49h\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.193829 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.193785 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s424p" Jul 28 17:09:59.394430 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.394271 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s424p"] Jul 28 17:09:59.398080 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:09:59.398053 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62ff42b_7e5d_4310_bb19_00a15b991f42.slice/crio-54e1527877ca5d0e3f4ffc46fd93df9973eb1349787563291800dc24148bb526 WatchSource:0}: Error finding container 54e1527877ca5d0e3f4ffc46fd93df9973eb1349787563291800dc24148bb526: Status 404 returned error can't find the container with id 54e1527877ca5d0e3f4ffc46fd93df9973eb1349787563291800dc24148bb526 Jul 28 17:09:59.486455 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.486424 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerStarted","Data":"e71c838cbf40397f1ba29f848558daa49f46c03b74e86123777d5226a3c03f97"} Jul 28 17:09:59.487517 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.487481 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s424p" event={"ID":"c62ff42b-7e5d-4310-bb19-00a15b991f42","Type":"ContainerStarted","Data":"54e1527877ca5d0e3f4ffc46fd93df9973eb1349787563291800dc24148bb526"} Jul 28 17:09:59.535852 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.535824 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:09:59.536020 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.535972 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 17:09:59.536020 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.535993 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75df48b9c7-f9prp: secret "image-registry-tls" not found Jul 28 17:09:59.536123 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:09:59.536011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:09:59.536123 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.536062 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls podName:504ea955-8551-459b-8f9d-a39815fbd641 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:00.536042152 +0000 UTC m=+37.878201496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls") pod "image-registry-75df48b9c7-f9prp" (UID: "504ea955-8551-459b-8f9d-a39815fbd641") : secret "image-registry-tls" not found Jul 28 17:09:59.536123 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.536121 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:09:59.536285 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:09:59.536174 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls podName:e0467685-66af-4387-a17e-f30ecd28dcdf nodeName:}" failed. No retries permitted until 2026-07-28 17:10:00.536161532 +0000 UTC m=+37.878320860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls") pod "dns-default-kjd8p" (UID: "e0467685-66af-4387-a17e-f30ecd28dcdf") : secret "dns-default-metrics-tls" not found Jul 28 17:10:00.254985 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.254949 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:10:00.255173 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.255074 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:10:00.255173 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.255111 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:10:00.258820 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.258795 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:10:00.258968 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.258852 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nvllg\"" Jul 28 17:10:00.258968 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.258912 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:10:00.259074 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.258802 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:10:00.259172 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.259151 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mz7f2\"" Jul 28 17:10:00.259248 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.259213 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:10:00.495146 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.494818 2582 generic.go:356] "Generic (PLEG): container finished" podID="3bc75559-78ce-4b71-9a58-aeb5a07a5f33" containerID="e71c838cbf40397f1ba29f848558daa49f46c03b74e86123777d5226a3c03f97" exitCode=0 Jul 28 17:10:00.495146 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.494883 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerDied","Data":"e71c838cbf40397f1ba29f848558daa49f46c03b74e86123777d5226a3c03f97"} Jul 28 17:10:00.544105 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.544061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:10:00.544236 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:00.544138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:10:00.544236 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:00.544178 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 17:10:00.544236 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:00.544194 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75df48b9c7-f9prp: secret "image-registry-tls" not found Jul 28 17:10:00.544407 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:00.544253 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls podName:504ea955-8551-459b-8f9d-a39815fbd641 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:02.544235107 +0000 UTC m=+39.886394448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls") pod "image-registry-75df48b9c7-f9prp" (UID: "504ea955-8551-459b-8f9d-a39815fbd641") : secret "image-registry-tls" not found Jul 28 17:10:00.544407 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:00.544383 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:10:00.544506 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:00.544447 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls podName:e0467685-66af-4387-a17e-f30ecd28dcdf nodeName:}" failed. No retries permitted until 2026-07-28 17:10:02.544430608 +0000 UTC m=+39.886589937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls") pod "dns-default-kjd8p" (UID: "e0467685-66af-4387-a17e-f30ecd28dcdf") : secret "dns-default-metrics-tls" not found Jul 28 17:10:01.118408 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:01.118352 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:01.186170 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:01.186141 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:01.501131 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:01.501103 2582 generic.go:356] "Generic (PLEG): container finished" podID="3bc75559-78ce-4b71-9a58-aeb5a07a5f33" containerID="f523e6a09ecde53738c27269c76ec60555f65050d44030a32a924f777012611c" exitCode=0 Jul 28 17:10:01.501459 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:01.501150 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerDied","Data":"f523e6a09ecde53738c27269c76ec60555f65050d44030a32a924f777012611c"} Jul 28 17:10:02.507282 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:02.507118 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwr67" event={"ID":"3bc75559-78ce-4b71-9a58-aeb5a07a5f33","Type":"ContainerStarted","Data":"1b727d5a9bceb35cb54b4298298870e9217c726afb37b95cf6356e0cc02c1ae4"} Jul 28 17:10:02.508561 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:02.508542 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s424p" event={"ID":"c62ff42b-7e5d-4310-bb19-00a15b991f42","Type":"ContainerStarted","Data":"129617bbcad57e28a9f52759344f41d40ba43bc3da5a3d576bd7783c7b79de34"} Jul 28 17:10:02.532942 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:02.532878 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bwr67" podStartSLOduration=9.746804592 podStartE2EDuration="39.532864979s" totalImagesPullingTime="29.786060387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:02.531210552 +0000 UTC m=+39.873369914" watchObservedRunningTime="2026-07-28 17:10:02.532864979 +0000 UTC m=+39.875024330" Jul 28 17:10:02.548810 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:02.548768 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s424p" podStartSLOduration=2.307866482 podStartE2EDuration="4.548753887s" totalImagesPullingTime="2.240887405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:02.547901307 +0000 UTC m=+39.890060655" watchObservedRunningTime="2026-07-28 17:10:02.548753887 +0000 UTC m=+39.890913231" Jul 28 17:10:02.559379 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:02.559354 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:10:02.559703 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:02.559564 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:10:02.559703 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:02.559654 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 17:10:02.559703 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:02.559674 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:10:02.559881 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:02.559741 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls podName:e0467685-66af-4387-a17e-f30ecd28dcdf nodeName:}" failed. No retries permitted until 2026-07-28 17:10:06.559724088 +0000 UTC m=+43.901883437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls") pod "dns-default-kjd8p" (UID: "e0467685-66af-4387-a17e-f30ecd28dcdf") : secret "dns-default-metrics-tls" not found Jul 28 17:10:02.559881 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:02.559677 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75df48b9c7-f9prp: secret "image-registry-tls" not found Jul 28 17:10:02.559881 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:02.559823 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls podName:504ea955-8551-459b-8f9d-a39815fbd641 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:06.559804402 +0000 UTC m=+43.901963733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls") pod "image-registry-75df48b9c7-f9prp" (UID: "504ea955-8551-459b-8f9d-a39815fbd641") : secret "image-registry-tls" not found Jul 28 17:10:02.688111 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:02.688077 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:02.754464 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:02.754420 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:02.867816 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:02.867743 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:03.248178 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:03.248137 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:03.349706 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:03.349670 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:05.832166 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:05.832127 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:05.952686 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:05.952640 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:06.074462 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:06.074411 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:06.588332 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:06.588291 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:10:06.588332 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:06.588335 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:10:06.588559 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:06.588431 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:10:06.588559 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:06.588438 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 17:10:06.588559 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:06.588454 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75df48b9c7-f9prp: secret "image-registry-tls" not found Jul 28 17:10:06.588559 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:06.588481 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls podName:e0467685-66af-4387-a17e-f30ecd28dcdf nodeName:}" failed. No retries permitted until 2026-07-28 17:10:14.588467872 +0000 UTC m=+51.930627201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls") pod "dns-default-kjd8p" (UID: "e0467685-66af-4387-a17e-f30ecd28dcdf") : secret "dns-default-metrics-tls" not found Jul 28 17:10:06.588559 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:06.588493 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls podName:504ea955-8551-459b-8f9d-a39815fbd641 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:14.588487854 +0000 UTC m=+51.930647183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls") pod "image-registry-75df48b9c7-f9prp" (UID: "504ea955-8551-459b-8f9d-a39815fbd641") : secret "image-registry-tls" not found Jul 28 17:10:07.167618 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.167582 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:07.269754 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.269720 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:07.307032 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.306997 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-68t4w"] Jul 28 17:10:07.338594 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.338564 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-68t4w"] Jul 28 17:10:07.338738 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.338682 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.345053 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.345028 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 17:10:07.345175 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.345030 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 17:10:07.345175 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.345033 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 17:10:07.346232 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.346213 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xm8pw\"" Jul 28 17:10:07.346325 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.346235 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 17:10:07.365320 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.365295 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:07.394920 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.394890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-data-volume\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.394920 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.394936 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.395089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.394986 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-crio-socket\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.395089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.395028 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnhbx\" (UniqueName: \"kubernetes.io/projected/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-api-access-bnhbx\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.395089 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.395085 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.495616 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.495590 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.495706 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.495629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-crio-socket\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.495706 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.495649 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnhbx\" (UniqueName: \"kubernetes.io/projected/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-api-access-bnhbx\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.495781 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:07.495732 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:07.495781 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.495767 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.495863 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:07.495790 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls podName:e43cdc71-c28c-4fb8-a301-e60f41ef38d4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:07.995774854 +0000 UTC m=+45.337934182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68t4w" (UID: "e43cdc71-c28c-4fb8-a301-e60f41ef38d4") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:07.495863 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:07.495831 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 17:10:07.495863 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.495840 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-crio-socket\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.496039 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.495871 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-data-volume\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.496039 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:07.495896 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm podName:e43cdc71-c28c-4fb8-a301-e60f41ef38d4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:07.99588258 +0000 UTC m=+45.338041925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-68t4w" (UID: "e43cdc71-c28c-4fb8-a301-e60f41ef38d4") : configmap "kube-rbac-proxy" not found Jul 28 17:10:07.496172 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.496158 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-data-volume\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.508840 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.508812 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnhbx\" (UniqueName: \"kubernetes.io/projected/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-api-access-bnhbx\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.875993 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.875887 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:07.933903 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.933871 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:07.999609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.999575 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.999760 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:07.999666 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:07.999760 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:07.999705 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 17:10:07.999830 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:07.999777 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm podName:e43cdc71-c28c-4fb8-a301-e60f41ef38d4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:08.999755371 +0000 UTC m=+46.341914720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-68t4w" (UID: "e43cdc71-c28c-4fb8-a301-e60f41ef38d4") : configmap "kube-rbac-proxy" not found Jul 28 17:10:07.999830 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:07.999792 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:07.999900 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:07.999845 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls podName:e43cdc71-c28c-4fb8-a301-e60f41ef38d4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:08.999833308 +0000 UTC m=+46.341992637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68t4w" (UID: "e43cdc71-c28c-4fb8-a301-e60f41ef38d4") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:08.032258 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:08.032219 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:08.126908 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:08.126824 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:08.568130 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:08.568099 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:08.668546 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:08.668516 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:09.009055 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:09.009020 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:09.009235 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:09.009095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:09.009235 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:09.009169 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 17:10:09.009235 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:09.009190 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:09.009235 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:09.009233 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls podName:e43cdc71-c28c-4fb8-a301-e60f41ef38d4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:11.009220681 +0000 UTC m=+48.351380023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68t4w" (UID: "e43cdc71-c28c-4fb8-a301-e60f41ef38d4") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:09.009392 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:09.009248 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm podName:e43cdc71-c28c-4fb8-a301-e60f41ef38d4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:11.009241962 +0000 UTC m=+48.351401290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-68t4w" (UID: "e43cdc71-c28c-4fb8-a301-e60f41ef38d4") : configmap "kube-rbac-proxy" not found Jul 28 17:10:09.070132 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:09.070103 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:09.095209 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:09.095183 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kqr4w_42642d3c-a017-4969-8415-87c24243cf65/dns-node-resolver/0.log" Jul 28 17:10:09.172210 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:09.172178 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:10.098446 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.098420 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5ch8f_0a8de880-d4ae-479c-a1fa-24542a000e2d/node-ca/0.log" Jul 28 17:10:10.179199 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.179164 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-2s4rj"] Jul 28 17:10:10.207062 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.207003 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-2s4rj"] Jul 28 17:10:10.207205 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.207081 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.210185 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.210157 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 17:10:10.210319 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.210203 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 17:10:10.210319 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.210225 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 17:10:10.210319 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.210226 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 17:10:10.211373 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.211352 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vwbrt\"" Jul 28 17:10:10.229916 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.229894 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:10.301705 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.301658 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:10.319741 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.319715 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tc9m\" (UniqueName: \"kubernetes.io/projected/12ee6dcc-f99f-4f13-9d6b-5015f7ab896e-kube-api-access-6tc9m\") pod \"service-ca-658d7b7c78-2s4rj\" (UID: \"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e\") " pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.319826 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.319779 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/12ee6dcc-f99f-4f13-9d6b-5015f7ab896e-signing-cabundle\") pod \"service-ca-658d7b7c78-2s4rj\" (UID: \"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e\") " pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.319904 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.319888 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/12ee6dcc-f99f-4f13-9d6b-5015f7ab896e-signing-key\") pod \"service-ca-658d7b7c78-2s4rj\" (UID: \"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e\") " pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.421267 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.421174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/12ee6dcc-f99f-4f13-9d6b-5015f7ab896e-signing-key\") pod \"service-ca-658d7b7c78-2s4rj\" (UID: \"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e\") " pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.421267 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.421219 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tc9m\" (UniqueName: \"kubernetes.io/projected/12ee6dcc-f99f-4f13-9d6b-5015f7ab896e-kube-api-access-6tc9m\") pod \"service-ca-658d7b7c78-2s4rj\" (UID: \"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e\") " pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.421485 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.421279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/12ee6dcc-f99f-4f13-9d6b-5015f7ab896e-signing-cabundle\") pod \"service-ca-658d7b7c78-2s4rj\" (UID: \"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e\") " pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.421990 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.421971 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/12ee6dcc-f99f-4f13-9d6b-5015f7ab896e-signing-cabundle\") pod \"service-ca-658d7b7c78-2s4rj\" (UID: \"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e\") " pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.423562 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.423536 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/12ee6dcc-f99f-4f13-9d6b-5015f7ab896e-signing-key\") pod \"service-ca-658d7b7c78-2s4rj\" (UID: \"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e\") " pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.431568 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.431547 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tc9m\" (UniqueName: \"kubernetes.io/projected/12ee6dcc-f99f-4f13-9d6b-5015f7ab896e-kube-api-access-6tc9m\") pod \"service-ca-658d7b7c78-2s4rj\" (UID: \"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e\") " pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.516289 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.516250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" Jul 28 17:10:10.668280 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:10.668247 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-2s4rj"] Jul 28 17:10:11.026719 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:11.026690 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:11.026889 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:11.026773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:11.026889 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:11.026820 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 17:10:11.026889 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:11.026884 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm podName:e43cdc71-c28c-4fb8-a301-e60f41ef38d4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:15.026869329 +0000 UTC m=+52.369028658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-68t4w" (UID: "e43cdc71-c28c-4fb8-a301-e60f41ef38d4") : configmap "kube-rbac-proxy" not found Jul 28 17:10:11.027048 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:11.026891 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:11.027048 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:11.026947 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls podName:e43cdc71-c28c-4fb8-a301-e60f41ef38d4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:15.026920286 +0000 UTC m=+52.369079616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68t4w" (UID: "e43cdc71-c28c-4fb8-a301-e60f41ef38d4") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:11.298755 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:11.298632 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s424p_c62ff42b-7e5d-4310-bb19-00a15b991f42/serve-healthcheck-canary/0.log" Jul 28 17:10:11.358370 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:11.358330 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:11.532512 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:11.532466 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" event={"ID":"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e","Type":"ContainerStarted","Data":"17a1213a77a96b767e5224161df3348e5018d105cd8f2d8111d39ae854532150"} Jul 28 17:10:12.476225 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:12.476190 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:13.539127 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:13.539090 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" event={"ID":"12ee6dcc-f99f-4f13-9d6b-5015f7ab896e","Type":"ContainerStarted","Data":"98be6c6a575a56c234c9aa585b9dc7c9427ee2bbdef1b357deb711cc7bc9c601"} Jul 28 17:10:13.559758 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:13.559704 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-2s4rj" podStartSLOduration=1.126001947 podStartE2EDuration="3.559685256s" totalImagesPullingTime="2.433683309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:13.558192465 +0000 UTC m=+50.900351818" watchObservedRunningTime="2026-07-28 17:10:13.559685256 +0000 UTC m=+50.901844610" Jul 28 17:10:14.558993 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:14.558960 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:14.655250 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:14.655206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:10:14.655445 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:14.655270 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:10:14.655620 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:14.655600 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 17:10:14.655702 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:14.655622 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75df48b9c7-f9prp: secret "image-registry-tls" not found Jul 28 17:10:14.655702 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:14.655675 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls podName:504ea955-8551-459b-8f9d-a39815fbd641 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:30.655656395 +0000 UTC m=+67.997815724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls") pod "image-registry-75df48b9c7-f9prp" (UID: "504ea955-8551-459b-8f9d-a39815fbd641") : secret "image-registry-tls" not found Jul 28 17:10:14.655912 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:14.655888 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:10:14.656009 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:14.655967 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls podName:e0467685-66af-4387-a17e-f30ecd28dcdf nodeName:}" failed. No retries permitted until 2026-07-28 17:10:30.65594969 +0000 UTC m=+67.998109025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls") pod "dns-default-kjd8p" (UID: "e0467685-66af-4387-a17e-f30ecd28dcdf") : secret "dns-default-metrics-tls" not found Jul 28 17:10:14.659826 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:14.659798 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:14.760594 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:14.760561 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:14.871235 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:14.871141 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:14.995975 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:14.995911 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:15.059198 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:15.059166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:15.059380 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:15.059245 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:15.059380 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:15.059341 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:15.059472 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:15.059391 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls podName:e43cdc71-c28c-4fb8-a301-e60f41ef38d4 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:23.059378107 +0000 UTC m=+60.401537436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-68t4w" (UID: "e43cdc71-c28c-4fb8-a301-e60f41ef38d4") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:15.059733 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:15.059704 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:15.126364 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:15.126269 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:15.456476 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:15.456382 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:15.816399 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:15.816363 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:16.056507 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:16.056469 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:16.460666 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:16.460633 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:16.861444 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:16.861416 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:17.060771 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:17.060740 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:17.457032 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:17.456986 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:18.180980 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:18.180948 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:18.282336 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:18.282303 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:18.359313 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:18.359270 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:18.463845 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:18.463770 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:18.555919 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:18.555891 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:18.656763 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:18.656731 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:18.719056 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:18.718976 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:18.841148 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:18.841115 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:18.942294 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:18.942262 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:19.057287 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:19.057253 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:19.121872 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:19.121840 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:19.261211 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:19.261185 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:19.340361 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:19.340270 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:19.631396 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:19.631322 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:19.730968 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:19.730917 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:19.849161 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:19.849132 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:19.949298 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:19.949227 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:20.049730 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:20.049704 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:20.149651 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:20.149619 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:20.440307 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:20.440278 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:20.541054 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:20.541024 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:20.640631 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:20.640601 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:20.781767 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:20.781740 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:20.982639 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:20.982581 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:21.266881 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:21.266830 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:21.390398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:21.390369 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:21.686441 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:21.686319 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:22.074240 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:22.074195 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:22.254087 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:22.254052 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:22.826867 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:22.826833 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:22.927912 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:22.927883 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:23.127279 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:23.127202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:23.129457 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:23.129440 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e43cdc71-c28c-4fb8-a301-e60f41ef38d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-68t4w\" (UID: \"e43cdc71-c28c-4fb8-a301-e60f41ef38d4\") " pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:23.250677 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:23.250649 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xm8pw\"" Jul 28 17:10:23.257906 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:23.257873 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-68t4w" Jul 28 17:10:23.404126 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:23.404059 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-68t4w"] Jul 28 17:10:23.407459 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:23.407433 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43cdc71_c28c_4fb8_a301_e60f41ef38d4.slice/crio-bf3d8b31720ae09838d3e74a8bdb654b21798f336f3f1f2d2239ae3ed02f9cfd WatchSource:0}: Error finding container bf3d8b31720ae09838d3e74a8bdb654b21798f336f3f1f2d2239ae3ed02f9cfd: Status 404 returned error can't find the container with id bf3d8b31720ae09838d3e74a8bdb654b21798f336f3f1f2d2239ae3ed02f9cfd Jul 28 17:10:23.450436 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:23.450403 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:23.489611 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:23.489585 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xrs4m" Jul 28 17:10:23.565313 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:23.565280 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-68t4w" event={"ID":"e43cdc71-c28c-4fb8-a301-e60f41ef38d4","Type":"ContainerStarted","Data":"bf3d8b31720ae09838d3e74a8bdb654b21798f336f3f1f2d2239ae3ed02f9cfd"} Jul 28 17:10:23.649318 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:23.649287 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:24.046750 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:24.046713 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:24.243673 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:24.243639 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:24.850305 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:24.850273 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:25.247424 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:25.247391 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:25.447502 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:25.447463 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:25.646299 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:25.646225 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:27.475650 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:27.475610 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:27.578065 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:27.578035 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:28.876547 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:28.876523 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:10:28.879158 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:28.879135 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:10:28.888992 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:28.888970 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1532bb2e-4650-4582-aa75-6714e5c29108-original-pull-secret\") pod \"global-pull-secret-syncer-jk4l4\" (UID: \"1532bb2e-4650-4582-aa75-6714e5c29108\") " pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:10:28.977222 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:28.977175 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:10:28.986278 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:28.986253 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:10:28.990403 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:28.990383 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78774be-c7f7-43ae-a745-08394c8732b1-metrics-certs\") pod \"network-metrics-daemon-t2sqf\" (UID: \"f78774be-c7f7-43ae-a745-08394c8732b1\") " pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:10:29.066841 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.066806 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jk4l4" Jul 28 17:10:29.078083 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.078048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:10:29.081981 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.081957 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:10:29.082075 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.081979 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nvllg\"" Jul 28 17:10:29.089045 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.089010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t2sqf" Jul 28 17:10:29.091623 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.091601 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:10:29.101238 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.101213 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjczc\" (UniqueName: \"kubernetes.io/projected/23ac9a6a-7d2d-4707-b3b9-8092af22fa23-kube-api-access-gjczc\") pod \"network-check-target-mp4jl\" (UID: \"23ac9a6a-7d2d-4707-b3b9-8092af22fa23\") " pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:10:29.201827 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.201795 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jk4l4"] Jul 28 17:10:29.204746 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:29.204722 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1532bb2e_4650_4582_aa75_6714e5c29108.slice/crio-20356ca661a52aa57e0dd621dce48deabd1a47d3eb380a27c471c41b9e8c2ad6 WatchSource:0}: Error finding container 20356ca661a52aa57e0dd621dce48deabd1a47d3eb380a27c471c41b9e8c2ad6: Status 404 returned error can't find the container with id 20356ca661a52aa57e0dd621dce48deabd1a47d3eb380a27c471c41b9e8c2ad6 Jul 28 17:10:29.223436 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.223409 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t2sqf"] Jul 28 17:10:29.228607 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:29.228582 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78774be_c7f7_43ae_a745_08394c8732b1.slice/crio-8af45db11a478604901f08be331c57a5ab3395e7cb62da113fd1afd8542018e8 WatchSource:0}: Error finding container 8af45db11a478604901f08be331c57a5ab3395e7cb62da113fd1afd8542018e8: Status 404 returned error can't find the container with id 8af45db11a478604901f08be331c57a5ab3395e7cb62da113fd1afd8542018e8 Jul 28 17:10:29.376647 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.376575 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mz7f2\"" Jul 28 17:10:29.383271 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.383230 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:10:29.541097 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.541015 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mp4jl"] Jul 28 17:10:29.545362 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:29.545333 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ac9a6a_7d2d_4707_b3b9_8092af22fa23.slice/crio-25198522d42ad153339216704579d1a076e418dfec58fcb6344d17291f605f60 WatchSource:0}: Error finding container 25198522d42ad153339216704579d1a076e418dfec58fcb6344d17291f605f60: Status 404 returned error can't find the container with id 25198522d42ad153339216704579d1a076e418dfec58fcb6344d17291f605f60 Jul 28 17:10:29.583603 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.583535 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jk4l4" event={"ID":"1532bb2e-4650-4582-aa75-6714e5c29108","Type":"ContainerStarted","Data":"20356ca661a52aa57e0dd621dce48deabd1a47d3eb380a27c471c41b9e8c2ad6"} Jul 28 17:10:29.586061 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.585913 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-68t4w" event={"ID":"e43cdc71-c28c-4fb8-a301-e60f41ef38d4","Type":"ContainerStarted","Data":"444b8b2d4d6e4cf1fe0cbc79afdb03de258b2c751156ae2a7cbf02f223adbed1"} Jul 28 17:10:29.587537 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.587439 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mp4jl" event={"ID":"23ac9a6a-7d2d-4707-b3b9-8092af22fa23","Type":"ContainerStarted","Data":"25198522d42ad153339216704579d1a076e418dfec58fcb6344d17291f605f60"} Jul 28 17:10:29.588759 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:29.588683 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t2sqf" event={"ID":"f78774be-c7f7-43ae-a745-08394c8732b1","Type":"ContainerStarted","Data":"8af45db11a478604901f08be331c57a5ab3395e7cb62da113fd1afd8542018e8"} Jul 28 17:10:30.615978 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.615799 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75df48b9c7-f9prp"] Jul 28 17:10:30.616643 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:30.616092 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" podUID="504ea955-8551-459b-8f9d-a39815fbd641" Jul 28 17:10:30.632517 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.631809 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4"] Jul 28 17:10:30.644631 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.644599 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh"] Jul 28 17:10:30.644801 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.644783 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" Jul 28 17:10:30.647868 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.647842 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 28 17:10:30.648382 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.648170 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 17:10:30.648987 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.648903 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 17:10:30.649457 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.649262 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t5x7j\"" Jul 28 17:10:30.649457 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.649347 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 17:10:30.656606 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.656310 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4"] Jul 28 17:10:30.657581 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.657125 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh"] Jul 28 17:10:30.657581 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.657455 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.662699 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.662679 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 28 17:10:30.690305 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.690261 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:10:30.690513 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.690363 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:10:30.693563 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.693532 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"image-registry-75df48b9c7-f9prp\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:10:30.693686 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.693599 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0467685-66af-4387-a17e-f30ecd28dcdf-metrics-tls\") pod \"dns-default-kjd8p\" (UID: \"e0467685-66af-4387-a17e-f30ecd28dcdf\") " pod="openshift-dns/dns-default-kjd8p" Jul 28 17:10:30.704038 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.704012 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8842r\"" Jul 28 17:10:30.710704 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.710662 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kjd8p" Jul 28 17:10:30.735465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.735360 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:30.791556 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.791464 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlhpt\" (UniqueName: \"kubernetes.io/projected/ee83e9ea-a865-4c4f-ab44-19d8c05511b3-kube-api-access-jlhpt\") pod \"managed-serviceaccount-addon-agent-679cfddbcb-psmh4\" (UID: \"ee83e9ea-a865-4c4f-ab44-19d8c05511b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" Jul 28 17:10:30.791556 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.791519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpdr8\" (UniqueName: \"kubernetes.io/projected/a4184a92-b3f5-45d5-87ec-b34ae27bfdd8-kube-api-access-zpdr8\") pod \"klusterlet-addon-workmgr-67475cf7cf-wxmqh\" (UID: \"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.791807 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.791605 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4184a92-b3f5-45d5-87ec-b34ae27bfdd8-tmp\") pod \"klusterlet-addon-workmgr-67475cf7cf-wxmqh\" (UID: \"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.791807 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.791668 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee83e9ea-a865-4c4f-ab44-19d8c05511b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-679cfddbcb-psmh4\" (UID: \"ee83e9ea-a865-4c4f-ab44-19d8c05511b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" Jul 28 17:10:30.791807 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.791700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a4184a92-b3f5-45d5-87ec-b34ae27bfdd8-klusterlet-config\") pod \"klusterlet-addon-workmgr-67475cf7cf-wxmqh\" (UID: \"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.853386 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.853347 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:30.893068 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.892741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee83e9ea-a865-4c4f-ab44-19d8c05511b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-679cfddbcb-psmh4\" (UID: \"ee83e9ea-a865-4c4f-ab44-19d8c05511b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" Jul 28 17:10:30.893068 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.892792 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a4184a92-b3f5-45d5-87ec-b34ae27bfdd8-klusterlet-config\") pod \"klusterlet-addon-workmgr-67475cf7cf-wxmqh\" (UID: \"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.893068 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.892840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhpt\" (UniqueName: \"kubernetes.io/projected/ee83e9ea-a865-4c4f-ab44-19d8c05511b3-kube-api-access-jlhpt\") pod \"managed-serviceaccount-addon-agent-679cfddbcb-psmh4\" (UID: \"ee83e9ea-a865-4c4f-ab44-19d8c05511b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" Jul 28 17:10:30.893068 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.892879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdr8\" (UniqueName: \"kubernetes.io/projected/a4184a92-b3f5-45d5-87ec-b34ae27bfdd8-kube-api-access-zpdr8\") pod \"klusterlet-addon-workmgr-67475cf7cf-wxmqh\" (UID: \"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.893068 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.892912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4184a92-b3f5-45d5-87ec-b34ae27bfdd8-tmp\") pod \"klusterlet-addon-workmgr-67475cf7cf-wxmqh\" (UID: \"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.893448 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.893309 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4184a92-b3f5-45d5-87ec-b34ae27bfdd8-tmp\") pod \"klusterlet-addon-workmgr-67475cf7cf-wxmqh\" (UID: \"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.896798 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.896768 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a4184a92-b3f5-45d5-87ec-b34ae27bfdd8-klusterlet-config\") pod \"klusterlet-addon-workmgr-67475cf7cf-wxmqh\" (UID: \"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.897484 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.897442 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee83e9ea-a865-4c4f-ab44-19d8c05511b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-679cfddbcb-psmh4\" (UID: \"ee83e9ea-a865-4c4f-ab44-19d8c05511b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" Jul 28 17:10:30.909010 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.908958 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpdr8\" (UniqueName: \"kubernetes.io/projected/a4184a92-b3f5-45d5-87ec-b34ae27bfdd8-kube-api-access-zpdr8\") pod \"klusterlet-addon-workmgr-67475cf7cf-wxmqh\" (UID: \"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:30.909704 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.909662 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlhpt\" (UniqueName: \"kubernetes.io/projected/ee83e9ea-a865-4c4f-ab44-19d8c05511b3-kube-api-access-jlhpt\") pod \"managed-serviceaccount-addon-agent-679cfddbcb-psmh4\" (UID: \"ee83e9ea-a865-4c4f-ab44-19d8c05511b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" Jul 28 17:10:30.950064 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.950027 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:30.967804 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.967730 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" Jul 28 17:10:30.978082 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:30.978001 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:31.239860 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.239824 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:31.341796 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.341714 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:31.595284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.595211 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:10:31.667101 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.667067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:10:31.801522 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.801493 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") pod \"504ea955-8551-459b-8f9d-a39815fbd641\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " Jul 28 17:10:31.801522 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.801528 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-bound-sa-token\") pod \"504ea955-8551-459b-8f9d-a39815fbd641\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " Jul 28 17:10:31.801728 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.801572 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-registry-certificates\") pod \"504ea955-8551-459b-8f9d-a39815fbd641\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " Jul 28 17:10:31.801728 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.801691 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-image-registry-private-configuration\") pod \"504ea955-8551-459b-8f9d-a39815fbd641\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " Jul 28 17:10:31.801820 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.801732 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn49h\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-kube-api-access-dn49h\") pod \"504ea955-8551-459b-8f9d-a39815fbd641\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " Jul 28 17:10:31.801820 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.801764 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-trusted-ca\") pod \"504ea955-8551-459b-8f9d-a39815fbd641\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " Jul 28 17:10:31.801820 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.801792 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-installation-pull-secrets\") pod \"504ea955-8551-459b-8f9d-a39815fbd641\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " Jul 28 17:10:31.801962 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.801835 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/504ea955-8551-459b-8f9d-a39815fbd641-ca-trust-extracted\") pod \"504ea955-8551-459b-8f9d-a39815fbd641\" (UID: \"504ea955-8551-459b-8f9d-a39815fbd641\") " Jul 28 17:10:31.802329 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.802276 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504ea955-8551-459b-8f9d-a39815fbd641-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "504ea955-8551-459b-8f9d-a39815fbd641" (UID: "504ea955-8551-459b-8f9d-a39815fbd641"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:10:31.802474 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.802328 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "504ea955-8551-459b-8f9d-a39815fbd641" (UID: "504ea955-8551-459b-8f9d-a39815fbd641"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:10:31.802611 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.802584 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "504ea955-8551-459b-8f9d-a39815fbd641" (UID: "504ea955-8551-459b-8f9d-a39815fbd641"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:10:31.804873 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.804843 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "504ea955-8551-459b-8f9d-a39815fbd641" (UID: "504ea955-8551-459b-8f9d-a39815fbd641"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:10:31.805471 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.805412 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "504ea955-8551-459b-8f9d-a39815fbd641" (UID: "504ea955-8551-459b-8f9d-a39815fbd641"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:10:31.805760 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.805731 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "504ea955-8551-459b-8f9d-a39815fbd641" (UID: "504ea955-8551-459b-8f9d-a39815fbd641"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:10:31.806094 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.806065 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-kube-api-access-dn49h" (OuterVolumeSpecName: "kube-api-access-dn49h") pod "504ea955-8551-459b-8f9d-a39815fbd641" (UID: "504ea955-8551-459b-8f9d-a39815fbd641"). InnerVolumeSpecName "kube-api-access-dn49h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:10:31.806596 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.806553 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "504ea955-8551-459b-8f9d-a39815fbd641" (UID: "504ea955-8551-459b-8f9d-a39815fbd641"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:10:31.903195 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.903117 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-image-registry-private-configuration\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:10:31.903195 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.903152 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn49h\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-kube-api-access-dn49h\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:10:31.903195 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.903164 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-trusted-ca\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:10:31.903195 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.903173 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/504ea955-8551-459b-8f9d-a39815fbd641-installation-pull-secrets\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:10:31.903195 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.903181 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/504ea955-8551-459b-8f9d-a39815fbd641-ca-trust-extracted\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:10:31.903195 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.903193 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-registry-tls\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:10:31.903574 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.903206 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/504ea955-8551-459b-8f9d-a39815fbd641-bound-sa-token\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:10:31.903574 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:31.903219 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/504ea955-8551-459b-8f9d-a39815fbd641-registry-certificates\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:10:32.076209 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.076163 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f84bff75b-flcv4"] Jul 28 17:10:32.118607 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.118570 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f84bff75b-flcv4"] Jul 28 17:10:32.118794 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.118722 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.121616 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.121590 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 17:10:32.121616 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.121609 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 17:10:32.121807 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.121636 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 17:10:32.121807 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.121778 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 17:10:32.121918 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.121826 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 17:10:32.121918 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.121829 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 17:10:32.122063 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.121912 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 17:10:32.122598 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.122581 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fcpnl\"" Jul 28 17:10:32.206488 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.206392 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-console-config\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.206488 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.206437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvzl6\" (UniqueName: \"kubernetes.io/projected/06b96724-e607-4a21-ace1-05b0655d4cac-kube-api-access-kvzl6\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.206739 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.206514 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-serving-cert\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.206739 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.206535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-oauth-serving-cert\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.206739 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.206584 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-oauth-config\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.206739 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.206601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-service-ca\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.307814 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.307778 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-serving-cert\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.307814 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.307818 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-oauth-serving-cert\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.308097 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.307844 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-oauth-config\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.308097 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.307860 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-service-ca\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.308097 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.307891 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-console-config\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.308097 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.307918 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvzl6\" (UniqueName: \"kubernetes.io/projected/06b96724-e607-4a21-ace1-05b0655d4cac-kube-api-access-kvzl6\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.308691 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.308662 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-service-ca\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.308792 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.308768 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-oauth-serving-cert\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.308863 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.308832 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-console-config\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.310761 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.310736 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-oauth-config\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.310884 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.310806 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-serving-cert\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.318503 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.318476 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvzl6\" (UniqueName: \"kubernetes.io/projected/06b96724-e607-4a21-ace1-05b0655d4cac-kube-api-access-kvzl6\") pod \"console-5f84bff75b-flcv4\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.429667 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.429625 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:32.474159 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.474132 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:32.573487 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.573454 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:32.597081 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.597055 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75df48b9c7-f9prp" Jul 28 17:10:32.645012 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.644984 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75df48b9c7-f9prp"] Jul 28 17:10:32.657665 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:32.657636 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75df48b9c7-f9prp"] Jul 28 17:10:33.262913 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:33.262880 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504ea955-8551-459b-8f9d-a39815fbd641" path="/var/lib/kubelet/pods/504ea955-8551-459b-8f9d-a39815fbd641/volumes" Jul 28 17:10:35.797661 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:35.796837 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f84bff75b-flcv4"] Jul 28 17:10:35.802007 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:35.801964 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b96724_e607_4a21_ace1_05b0655d4cac.slice/crio-c8114a0aef4494739157cb1dd45852430bbc296654f822e3b747270b0e6f2f0a WatchSource:0}: Error finding container c8114a0aef4494739157cb1dd45852430bbc296654f822e3b747270b0e6f2f0a: Status 404 returned error can't find the container with id c8114a0aef4494739157cb1dd45852430bbc296654f822e3b747270b0e6f2f0a Jul 28 17:10:35.820843 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:35.820804 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kjd8p"] Jul 28 17:10:35.825510 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:35.825465 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0467685_66af_4387_a17e_f30ecd28dcdf.slice/crio-ca44af7b7047e976ab4f623ea2f6629caf64b2f52569b9db1a3e6255ca5bdb05 WatchSource:0}: Error finding container ca44af7b7047e976ab4f623ea2f6629caf64b2f52569b9db1a3e6255ca5bdb05: Status 404 returned error can't find the container with id ca44af7b7047e976ab4f623ea2f6629caf64b2f52569b9db1a3e6255ca5bdb05 Jul 28 17:10:35.839777 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:35.839070 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh"] Jul 28 17:10:35.844235 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:35.844206 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4184a92_b3f5_45d5_87ec_b34ae27bfdd8.slice/crio-265cdd88d985b719fdafe2671b19bb205a94786d1a015f73bfdf82ebba63a2dd WatchSource:0}: Error finding container 265cdd88d985b719fdafe2671b19bb205a94786d1a015f73bfdf82ebba63a2dd: Status 404 returned error can't find the container with id 265cdd88d985b719fdafe2671b19bb205a94786d1a015f73bfdf82ebba63a2dd Jul 28 17:10:36.039127 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.039041 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4"] Jul 28 17:10:36.042139 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:36.042108 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee83e9ea_a865_4c4f_ab44_19d8c05511b3.slice/crio-e592d9d874abe657164bc45e88872a8a975cdd3c78c81a95ac946f62743d79a5 WatchSource:0}: Error finding container e592d9d874abe657164bc45e88872a8a975cdd3c78c81a95ac946f62743d79a5: Status 404 returned error can't find the container with id e592d9d874abe657164bc45e88872a8a975cdd3c78c81a95ac946f62743d79a5 Jul 28 17:10:36.262440 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.262347 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:36.322352 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.322239 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:36.619788 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.619634 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jk4l4" event={"ID":"1532bb2e-4650-4582-aa75-6714e5c29108","Type":"ContainerStarted","Data":"ead6c6ce582fb55518cb2d4bbc7335c5256bb58b318d543fa1809595bc56ed86"} Jul 28 17:10:36.624787 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.624757 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" event={"ID":"ee83e9ea-a865-4c4f-ab44-19d8c05511b3","Type":"ContainerStarted","Data":"e592d9d874abe657164bc45e88872a8a975cdd3c78c81a95ac946f62743d79a5"} Jul 28 17:10:36.629710 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.629614 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-68t4w" event={"ID":"e43cdc71-c28c-4fb8-a301-e60f41ef38d4","Type":"ContainerStarted","Data":"859212c75c746ea71b4e353ead9147d71826b936d9eff151897fb56fa2ac182e"} Jul 28 17:10:36.635969 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.635425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mp4jl" event={"ID":"23ac9a6a-7d2d-4707-b3b9-8092af22fa23","Type":"ContainerStarted","Data":"6d3004762b66d938013daa8fcc5666bcc38bfd43a4a09d4e7ff93e9ee6cda19c"} Jul 28 17:10:36.636361 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.636267 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:10:36.639954 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.638841 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jk4l4" podStartSLOduration=67.216322415 podStartE2EDuration="1m13.638823331s" totalImagesPullingTime="6.422500916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:36.637008861 +0000 UTC m=+73.979168212" watchObservedRunningTime="2026-07-28 17:10:36.638823331 +0000 UTC m=+73.980982681" Jul 28 17:10:36.643577 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.643543 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kjd8p" event={"ID":"e0467685-66af-4387-a17e-f30ecd28dcdf","Type":"ContainerStarted","Data":"ca44af7b7047e976ab4f623ea2f6629caf64b2f52569b9db1a3e6255ca5bdb05"} Jul 28 17:10:36.645965 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.645878 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" event={"ID":"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8","Type":"ContainerStarted","Data":"265cdd88d985b719fdafe2671b19bb205a94786d1a015f73bfdf82ebba63a2dd"} Jul 28 17:10:36.648647 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.648077 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t2sqf" event={"ID":"f78774be-c7f7-43ae-a745-08394c8732b1","Type":"ContainerStarted","Data":"dc225438fa24d136e0a2d5155b2da2d1d6bb5e8e3147bf3faccc722535efab92"} Jul 28 17:10:36.648647 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.648125 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t2sqf" event={"ID":"f78774be-c7f7-43ae-a745-08394c8732b1","Type":"ContainerStarted","Data":"820295bae6cb3424ba61952149136345c4a5bd0c033903488fc64a4cb1aff222"} Jul 28 17:10:36.651112 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.651053 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f84bff75b-flcv4" event={"ID":"06b96724-e607-4a21-ace1-05b0655d4cac","Type":"ContainerStarted","Data":"c8114a0aef4494739157cb1dd45852430bbc296654f822e3b747270b0e6f2f0a"} Jul 28 17:10:36.660454 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.660215 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mp4jl" podStartSLOduration=67.61543388 podStartE2EDuration="1m13.660202504s" totalImagesPullingTime="6.044768624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:36.658954131 +0000 UTC m=+74.001113484" watchObservedRunningTime="2026-07-28 17:10:36.660202504 +0000 UTC m=+74.002361858" Jul 28 17:10:36.787363 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.787262 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:36.889843 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:36.889726 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:37.055178 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.055118 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t2sqf" podStartSLOduration=67.774731832 podStartE2EDuration="1m14.055096858s" totalImagesPullingTime="6.280365026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:36.682665765 +0000 UTC m=+74.024825131" watchObservedRunningTime="2026-07-28 17:10:37.055096858 +0000 UTC m=+74.397256207" Jul 28 17:10:37.057154 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.057126 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64bcd65589-h7w6m"] Jul 28 17:10:37.060470 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.060453 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.062209 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.062159 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64bcd65589-h7w6m"] Jul 28 17:10:37.073453 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.073072 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 17:10:37.155495 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.155113 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-service-ca\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.155495 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.155154 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-trusted-ca-bundle\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.155495 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.155185 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxglp\" (UniqueName: \"kubernetes.io/projected/ba89fea3-4472-4d44-9538-e93fa5733eb3-kube-api-access-nxglp\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.155495 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.155222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-serving-cert\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.155495 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.155245 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-config\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.155495 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.155284 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-oauth-serving-cert\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.155495 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.155338 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-oauth-config\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.259778 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.257785 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-service-ca\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.259778 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.257826 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-trusted-ca-bundle\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.259778 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.257855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxglp\" (UniqueName: \"kubernetes.io/projected/ba89fea3-4472-4d44-9538-e93fa5733eb3-kube-api-access-nxglp\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.259778 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.257890 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-serving-cert\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.259778 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.257912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-config\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.259778 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.257958 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-oauth-serving-cert\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.259778 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.258013 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-oauth-config\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.262620 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.261166 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-trusted-ca-bundle\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.262620 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.261691 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-config\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.262620 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.262552 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-oauth-serving-cert\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.263080 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.263024 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-service-ca\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.270404 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.269944 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-oauth-config\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.270404 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.270361 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-serving-cert\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.286206 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.286134 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxglp\" (UniqueName: \"kubernetes.io/projected/ba89fea3-4472-4d44-9538-e93fa5733eb3-kube-api-access-nxglp\") pod \"console-64bcd65589-h7w6m\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.377445 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.377408 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:37.602770 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.602586 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64bcd65589-h7w6m"] Jul 28 17:10:37.616583 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:37.616545 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba89fea3_4472_4d44_9538_e93fa5733eb3.slice/crio-d901865e098602df79fc0490f6d7721ad6768594b64684224dc2fd064cac666a WatchSource:0}: Error finding container d901865e098602df79fc0490f6d7721ad6768594b64684224dc2fd064cac666a: Status 404 returned error can't find the container with id d901865e098602df79fc0490f6d7721ad6768594b64684224dc2fd064cac666a Jul 28 17:10:37.661759 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:37.661438 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcd65589-h7w6m" event={"ID":"ba89fea3-4472-4d44-9538-e93fa5733eb3","Type":"ContainerStarted","Data":"d901865e098602df79fc0490f6d7721ad6768594b64684224dc2fd064cac666a"} Jul 28 17:10:38.665030 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:38.664635 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:38.765602 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:38.765512 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:38.870077 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:38.869955 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:38.998155 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:38.997101 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6"] Jul 28 17:10:39.001692 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.000716 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" Jul 28 17:10:39.003684 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.003659 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 17:10:39.004206 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.003985 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-z6x8h\"" Jul 28 17:10:39.022238 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.021387 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6"] Jul 28 17:10:39.032370 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.032334 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:39.176276 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.173642 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/15c7486c-07b6-499a-97cb-eeec7bdbc953-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-8jcv6\" (UID: \"15c7486c-07b6-499a-97cb-eeec7bdbc953\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" Jul 28 17:10:39.267831 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.267754 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:39.274447 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.274413 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/15c7486c-07b6-499a-97cb-eeec7bdbc953-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-8jcv6\" (UID: \"15c7486c-07b6-499a-97cb-eeec7bdbc953\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" Jul 28 17:10:39.286258 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.286152 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/15c7486c-07b6-499a-97cb-eeec7bdbc953-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-8jcv6\" (UID: \"15c7486c-07b6-499a-97cb-eeec7bdbc953\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" Jul 28 17:10:39.321346 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.321119 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" Jul 28 17:10:39.369130 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.369088 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:39.490463 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:39.490429 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:41.930265 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:41.930231 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:41.996104 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:41.996069 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:42.063414 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:42.063379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:42.485436 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:42.485405 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:42.547735 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:42.547701 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:44.226688 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.226489 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6"] Jul 28 17:10:44.232106 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:44.232084 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c7486c_07b6_499a_97cb_eeec7bdbc953.slice/crio-653c950a96c885d204b9d96a1d3f461e01a59bfa18e9e7a4697a6bfaf75e4ffc WatchSource:0}: Error finding container 653c950a96c885d204b9d96a1d3f461e01a59bfa18e9e7a4697a6bfaf75e4ffc: Status 404 returned error can't find the container with id 653c950a96c885d204b9d96a1d3f461e01a59bfa18e9e7a4697a6bfaf75e4ffc Jul 28 17:10:44.697368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.697276 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kjd8p" event={"ID":"e0467685-66af-4387-a17e-f30ecd28dcdf","Type":"ContainerStarted","Data":"914d4e9ab6631e57178e1d9f18d1aba3531bb1001f4e1690412cdcddb52c18f5"} Jul 28 17:10:44.697368 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.697362 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kjd8p" event={"ID":"e0467685-66af-4387-a17e-f30ecd28dcdf","Type":"ContainerStarted","Data":"f02c50fe296ce8e682a5191a49ac9b68db3f379f0e0c4b06be6b8fe5db9258d5"} Jul 28 17:10:44.697599 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.697397 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kjd8p" Jul 28 17:10:44.698689 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.698667 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" event={"ID":"a4184a92-b3f5-45d5-87ec-b34ae27bfdd8","Type":"ContainerStarted","Data":"ccbcddba16e268cde30739df294c773951f009e3b31cf9f2f08e81eaaf670410"} Jul 28 17:10:44.698847 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.698772 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:44.700440 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.700411 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcd65589-h7w6m" event={"ID":"ba89fea3-4472-4d44-9538-e93fa5733eb3","Type":"ContainerStarted","Data":"85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a"} Jul 28 17:10:44.700649 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.700625 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" Jul 28 17:10:44.702021 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.701998 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f84bff75b-flcv4" event={"ID":"06b96724-e607-4a21-ace1-05b0655d4cac","Type":"ContainerStarted","Data":"646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b"} Jul 28 17:10:44.703263 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.703246 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" event={"ID":"ee83e9ea-a865-4c4f-ab44-19d8c05511b3","Type":"ContainerStarted","Data":"c5c7c84cc6ab3c1fb791c22a271fb00462ffe9b567b4c7b638b3b5aee9b4d4a6"} Jul 28 17:10:44.704419 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.704378 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" event={"ID":"15c7486c-07b6-499a-97cb-eeec7bdbc953","Type":"ContainerStarted","Data":"653c950a96c885d204b9d96a1d3f461e01a59bfa18e9e7a4697a6bfaf75e4ffc"} Jul 28 17:10:44.706277 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.706259 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-68t4w" event={"ID":"e43cdc71-c28c-4fb8-a301-e60f41ef38d4","Type":"ContainerStarted","Data":"1e4823d963987ee4e0b8645823cd7f49fac529484fbb2befff4267fb6e5b9e30"} Jul 28 17:10:44.720537 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.720488 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kjd8p" podStartSLOduration=38.463748983 podStartE2EDuration="46.720474894s" totalImagesPullingTime="8.256725911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:44.718417186 +0000 UTC m=+82.060576537" watchObservedRunningTime="2026-07-28 17:10:44.720474894 +0000 UTC m=+82.062634244" Jul 28 17:10:44.738203 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.737905 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f84bff75b-flcv4" podStartSLOduration=4.4502176030000005 podStartE2EDuration="12.737887102s" totalImagesPullingTime="8.287669499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:44.737753428 +0000 UTC m=+82.079912806" watchObservedRunningTime="2026-07-28 17:10:44.737887102 +0000 UTC m=+82.080046449" Jul 28 17:10:44.760806 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.760607 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64bcd65589-h7w6m" podStartSLOduration=1.208857231 podStartE2EDuration="7.760585659s" totalImagesPullingTime="6.551728428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:44.759411477 +0000 UTC m=+82.101570841" watchObservedRunningTime="2026-07-28 17:10:44.760585659 +0000 UTC m=+82.102745005" Jul 28 17:10:44.778587 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.778515 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67475cf7cf-wxmqh" podStartSLOduration=6.452542602 podStartE2EDuration="14.778497927s" totalImagesPullingTime="8.325955325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:44.778416141 +0000 UTC m=+82.120575495" watchObservedRunningTime="2026-07-28 17:10:44.778497927 +0000 UTC m=+82.120657279" Jul 28 17:10:44.799898 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.799830 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-68t4w" podStartSLOduration=17.216606661 podStartE2EDuration="37.799809597s" totalImagesPullingTime="20.583202936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:44.798564664 +0000 UTC m=+82.140724029" watchObservedRunningTime="2026-07-28 17:10:44.799809597 +0000 UTC m=+82.141968949" Jul 28 17:10:44.814879 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:44.814812 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-679cfddbcb-psmh4" podStartSLOduration=6.770303279 podStartE2EDuration="14.814791913s" totalImagesPullingTime="8.044488634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:44.814458168 +0000 UTC m=+82.156617520" watchObservedRunningTime="2026-07-28 17:10:44.814791913 +0000 UTC m=+82.156951265" Jul 28 17:10:45.711537 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:45.711449 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" event={"ID":"15c7486c-07b6-499a-97cb-eeec7bdbc953","Type":"ContainerStarted","Data":"74ba1de4688ea6ae613ffce6e74d070bc21d8210f95e88f982436cb4b449e49f"} Jul 28 17:10:45.712415 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:45.712382 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" Jul 28 17:10:45.716742 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:45.716718 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" Jul 28 17:10:45.743313 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:45.743266 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-8jcv6" podStartSLOduration=6.6927333319999995 podStartE2EDuration="7.743247303s" totalImagesPullingTime="1.050513971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:45.742983886 +0000 UTC m=+83.085143239" watchObservedRunningTime="2026-07-28 17:10:45.743247303 +0000 UTC m=+83.085406654" Jul 28 17:10:45.843838 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:45.843805 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:45.954113 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:45.954034 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:46.078965 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.078902 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:46.159262 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.159235 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-lspd6"] Jul 28 17:10:46.163123 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.163104 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.170316 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.170295 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 17:10:46.170848 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.170823 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 17:10:46.171565 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.171548 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 17:10:46.171658 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.171575 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 17:10:46.171896 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.171883 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 17:10:46.171962 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.171891 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gxjs2\"" Jul 28 17:10:46.177313 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.177290 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-lspd6"] Jul 28 17:10:46.187230 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.187179 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:46.237188 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.237161 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm65b\" (UniqueName: \"kubernetes.io/projected/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-kube-api-access-rm65b\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.237356 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.237203 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.237356 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.237227 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.237356 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.237286 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.267015 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.266989 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:46.338192 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.338112 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.338192 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.338163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm65b\" (UniqueName: \"kubernetes.io/projected/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-kube-api-access-rm65b\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.338398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.338277 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.338398 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.338313 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.338881 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.338862 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.340570 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.340550 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.340668 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.340650 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.348610 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.348584 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm65b\" (UniqueName: \"kubernetes.io/projected/ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b-kube-api-access-rm65b\") pod \"prometheus-operator-84d69f794d-lspd6\" (UID: \"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.474422 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.474389 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" Jul 28 17:10:46.604260 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.602429 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-lspd6"] Jul 28 17:10:46.716619 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:46.716579 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" event={"ID":"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b","Type":"ContainerStarted","Data":"a7e9a955510043edf7299d468a866265f010ee8077c94636a917a5af3d388804"} Jul 28 17:10:47.378810 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:47.378774 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:47.378986 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:47.378844 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:47.383433 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:47.383414 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:47.725067 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:47.725002 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:10:47.806230 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:47.806195 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f84bff75b-flcv4"] Jul 28 17:10:47.934608 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:47.934576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:48.134390 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:48.134363 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:48.233222 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:48.233181 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:48.353402 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:48.353322 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:48.726147 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:48.726063 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" event={"ID":"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b","Type":"ContainerStarted","Data":"45c696119675e9bf162b3e02751efcb51e1ae71a68ffe06053fe1740f7201102"} Jul 28 17:10:48.726147 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:48.726115 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" event={"ID":"ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b","Type":"ContainerStarted","Data":"12b6010687bda133fb1dce9b0d8e2e8bb13401c6e60e9ed965c2c4f9aadcabd1"} Jul 28 17:10:48.751485 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:48.751431 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-lspd6" podStartSLOduration=1.282189916 podStartE2EDuration="2.751417025s" totalImagesPullingTime="1.469227109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:48.749889997 +0000 UTC m=+86.092049348" watchObservedRunningTime="2026-07-28 17:10:48.751417025 +0000 UTC m=+86.093576376" Jul 28 17:10:50.249936 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.249893 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:50.355670 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.355630 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:50.493988 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.493939 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:50.552462 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.552376 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq"] Jul 28 17:10:50.556253 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.556223 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.558296 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.558273 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7gdv5"] Jul 28 17:10:50.559643 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.559616 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2xw64\"" Jul 28 17:10:50.559745 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.559670 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 17:10:50.560978 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.560959 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 17:10:50.561086 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.560966 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 17:10:50.561271 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.561256 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.563850 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.563833 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 17:10:50.563981 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.563914 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mdzx4\"" Jul 28 17:10:50.564258 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.564238 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 17:10:50.564373 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.564305 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 17:10:50.565821 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.565799 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0a9053e-bfa4-44ae-9d20-693623694c1a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.565955 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.565833 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhwkm\" (UniqueName: \"kubernetes.io/projected/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-api-access-dhwkm\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.565955 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.565866 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-root\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.565955 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.565891 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-tls\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.565955 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.565937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.566223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.565987 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.566223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.566041 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-metrics-client-ca\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.566223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.566068 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c0a9053e-bfa4-44ae-9d20-693623694c1a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.566223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.566106 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-wtmp\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.566223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.566133 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.566223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.566170 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn95b\" (UniqueName: \"kubernetes.io/projected/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-kube-api-access-hn95b\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.566223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.566204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.566527 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.566239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.566527 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.566281 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-textfile\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.566527 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.566314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-sys\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.570911 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.570889 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq"] Jul 28 17:10:50.609675 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.609646 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:50.667279 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-metrics-client-ca\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667279 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667285 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c0a9053e-bfa4-44ae-9d20-693623694c1a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.667521 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667315 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-wtmp\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667521 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667343 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.667521 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667371 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn95b\" (UniqueName: \"kubernetes.io/projected/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-kube-api-access-hn95b\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667521 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667403 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.667521 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667441 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.667521 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667464 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-textfile\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667521 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667489 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-sys\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667880 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667527 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0a9053e-bfa4-44ae-9d20-693623694c1a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.667880 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhwkm\" (UniqueName: \"kubernetes.io/projected/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-api-access-dhwkm\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.667880 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667556 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-wtmp\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667880 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-root\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667880 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667603 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-tls\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667880 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667880 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667669 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.667880 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667696 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c0a9053e-bfa4-44ae-9d20-693623694c1a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.667880 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667826 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-textfile\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.668350 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.667942 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-metrics-client-ca\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.668350 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:50.668044 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 17:10:50.668350 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.668046 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-sys\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.668350 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:50.668111 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-tls podName:4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb nodeName:}" failed. No retries permitted until 2026-07-28 17:10:51.168091811 +0000 UTC m=+88.510251143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-tls") pod "node-exporter-7gdv5" (UID: "4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb") : secret "node-exporter-tls" not found Jul 28 17:10:50.668571 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.668372 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-root\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.668571 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:50.668459 2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 28 17:10:50.668571 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:10:50.668504 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-tls podName:c0a9053e-bfa4-44ae-9d20-693623694c1a nodeName:}" failed. No retries permitted until 2026-07-28 17:10:51.168489124 +0000 UTC m=+88.510648460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-xhvlq" (UID: "c0a9053e-bfa4-44ae-9d20-693623694c1a") : secret "kube-state-metrics-tls" not found Jul 28 17:10:50.668723 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.668636 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0a9053e-bfa4-44ae-9d20-693623694c1a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.668723 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.668691 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.668979 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.668961 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.670410 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.670385 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.670855 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.670829 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.676782 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.676760 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhwkm\" (UniqueName: \"kubernetes.io/projected/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-api-access-dhwkm\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:50.677491 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.677450 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn95b\" (UniqueName: \"kubernetes.io/projected/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-kube-api-access-hn95b\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:50.749201 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.749165 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:50.849133 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.849051 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:50.980506 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:50.980471 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:51.081529 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.081496 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:51.171265 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.171178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:51.171265 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.171242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-tls\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:51.173726 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.173699 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb-node-exporter-tls\") pod \"node-exporter-7gdv5\" (UID: \"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb\") " pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:51.173865 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.173760 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0a9053e-bfa4-44ae-9d20-693623694c1a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xhvlq\" (UID: \"c0a9053e-bfa4-44ae-9d20-693623694c1a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:51.176625 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.176604 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gdv5" Jul 28 17:10:51.188886 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:51.188857 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1ab27f_ceea_42ec_a2fc_171c1cdb8fcb.slice/crio-b8d6701e4ceeb54c47063d802878f73b9e854f758176db4d8cf405ba31826db0 WatchSource:0}: Error finding container b8d6701e4ceeb54c47063d802878f73b9e854f758176db4d8cf405ba31826db0: Status 404 returned error can't find the container with id b8d6701e4ceeb54c47063d802878f73b9e854f758176db4d8cf405ba31826db0 Jul 28 17:10:51.224324 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.224293 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:51.370212 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.370179 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:51.469861 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.469789 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" Jul 28 17:10:51.573681 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.572984 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:51.615402 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.615371 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq"] Jul 28 17:10:51.618263 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:51.618236 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a9053e_bfa4_44ae_9d20_693623694c1a.slice/crio-e310935528a230b7f387e91895ae68ad167380bcb4a3edd50ed8deedd6ff83fc WatchSource:0}: Error finding container e310935528a230b7f387e91895ae68ad167380bcb4a3edd50ed8deedd6ff83fc: Status 404 returned error can't find the container with id e310935528a230b7f387e91895ae68ad167380bcb4a3edd50ed8deedd6ff83fc Jul 28 17:10:51.660619 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.660588 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:51.670832 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.670803 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:10:51.676550 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.676523 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.679443 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.679416 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pzbzc\"" Jul 28 17:10:51.679581 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.679417 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 17:10:51.683268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.682720 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 17:10:51.683268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.682791 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 17:10:51.683268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.682848 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 17:10:51.683268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.682873 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 17:10:51.683268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.682951 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 17:10:51.683268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.683035 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 17:10:51.683268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.683059 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 17:10:51.683268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.683090 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 17:10:51.691897 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.691873 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:10:51.743745 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.743707 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" event={"ID":"c0a9053e-bfa4-44ae-9d20-693623694c1a","Type":"ContainerStarted","Data":"e310935528a230b7f387e91895ae68ad167380bcb4a3edd50ed8deedd6ff83fc"} Jul 28 17:10:51.745047 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.745016 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gdv5" event={"ID":"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb","Type":"ContainerStarted","Data":"b8d6701e4ceeb54c47063d802878f73b9e854f758176db4d8cf405ba31826db0"} Jul 28 17:10:51.755682 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.755653 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:51.775721 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.775690 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.775721 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.775724 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-web-config\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776127 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.775741 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776127 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.775773 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776127 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.775829 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776127 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.776061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-config-out\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776127 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.776101 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776381 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.776136 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776381 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.776198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776381 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.776259 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776381 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.776289 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776381 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.776324 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.776381 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.776351 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl8mr\" (UniqueName: \"kubernetes.io/projected/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-kube-api-access-zl8mr\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.865732 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.865691 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:51.877657 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877619 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.877820 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877671 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl8mr\" (UniqueName: \"kubernetes.io/projected/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-kube-api-access-zl8mr\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.877820 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877723 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.877820 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-web-config\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.877820 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.878060 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877821 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.878060 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877860 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.878060 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-config-out\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.878060 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877961 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.878060 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.877990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.878060 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.878029 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.878351 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.878064 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.878351 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.878095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.879392 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.878893 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.879392 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.879250 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.880233 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.880178 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.881404 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.881372 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.882323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.881611 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.882323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.881789 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-web-config\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.882323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.881881 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.882323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.881956 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-config-out\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.882323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.882179 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.882323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.882244 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.882840 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.882820 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.883373 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.883353 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.888761 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.888741 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl8mr\" (UniqueName: \"kubernetes.io/projected/f2c9e9cf-83af-4e03-9bdf-f06766702cc7-kube-api-access-zl8mr\") pod \"alertmanager-main-0\" (UID: \"f2c9e9cf-83af-4e03-9bdf-f06766702cc7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:51.990612 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:51.990571 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 17:10:52.311601 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:52.311576 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 17:10:52.314912 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:10:52.314884 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c9e9cf_83af_4e03_9bdf_f06766702cc7.slice/crio-869e65509fd1fddc613fb06bdedfb97a201d6f460f1fa2e60e18daac72ec2abe WatchSource:0}: Error finding container 869e65509fd1fddc613fb06bdedfb97a201d6f460f1fa2e60e18daac72ec2abe: Status 404 returned error can't find the container with id 869e65509fd1fddc613fb06bdedfb97a201d6f460f1fa2e60e18daac72ec2abe Jul 28 17:10:52.430032 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:52.429965 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:10:52.749855 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:52.749822 2582 generic.go:356] "Generic (PLEG): container finished" podID="4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb" containerID="1b14af63c1be5216a09913223f420a216dd6e48c9fa0c4f441e08e3f4ccee046" exitCode=0 Jul 28 17:10:52.750060 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:52.749915 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gdv5" event={"ID":"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb","Type":"ContainerDied","Data":"1b14af63c1be5216a09913223f420a216dd6e48c9fa0c4f441e08e3f4ccee046"} Jul 28 17:10:52.751088 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:52.751064 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2c9e9cf-83af-4e03-9bdf-f06766702cc7","Type":"ContainerStarted","Data":"869e65509fd1fddc613fb06bdedfb97a201d6f460f1fa2e60e18daac72ec2abe"} Jul 28 17:10:53.519681 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.519580 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:53.623783 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.623752 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:53.757945 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.757892 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" event={"ID":"c0a9053e-bfa4-44ae-9d20-693623694c1a","Type":"ContainerStarted","Data":"a508901673423e9dc948e43d055f5c85ee75328f21eb5e5fccc054f30b38a842"} Jul 28 17:10:53.758088 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.757984 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" event={"ID":"c0a9053e-bfa4-44ae-9d20-693623694c1a","Type":"ContainerStarted","Data":"54a45d27468be5eb7090903c43515a68ebde72262ad1e475fda4637c12b08cab"} Jul 28 17:10:53.760334 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.760309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gdv5" event={"ID":"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb","Type":"ContainerStarted","Data":"2ac29b444f1b0729b4092fb9d8fdca9d66e7eeb517f4fb93533abd057233c50f"} Jul 28 17:10:53.760457 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.760354 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gdv5" event={"ID":"4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb","Type":"ContainerStarted","Data":"362824d52b3384b0c786e39d9c57cf9a7ceb9d4e1b19062b18a2b6db1e116741"} Jul 28 17:10:53.762763 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.762693 2582 generic.go:356] "Generic (PLEG): container finished" podID="f2c9e9cf-83af-4e03-9bdf-f06766702cc7" containerID="57d7c90579599bb40dc0e80113f11b82ef7e714f0cb7ba711df8d91f33ef7ea6" exitCode=0 Jul 28 17:10:53.762763 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.762753 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2c9e9cf-83af-4e03-9bdf-f06766702cc7","Type":"ContainerDied","Data":"57d7c90579599bb40dc0e80113f11b82ef7e714f0cb7ba711df8d91f33ef7ea6"} Jul 28 17:10:53.789633 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.789519 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7gdv5" podStartSLOduration=2.6864049789999997 podStartE2EDuration="3.789492442s" totalImagesPullingTime="1.037567567s" totalInitContainerRuntime="65.519896ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:53.788355028 +0000 UTC m=+91.130514400" watchObservedRunningTime="2026-07-28 17:10:53.789492442 +0000 UTC m=+91.131651796" Jul 28 17:10:53.889233 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.889180 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:53.957891 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:53.957856 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:54.029837 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:54.029740 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:54.129879 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:54.129847 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:54.400158 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:54.400074 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:54.714118 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:54.714031 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kjd8p" Jul 28 17:10:54.768831 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:54.768797 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" event={"ID":"c0a9053e-bfa4-44ae-9d20-693623694c1a","Type":"ContainerStarted","Data":"5db14fa8a5fd0e9cbf6e2c5952a0e6c60550a17b3480a12dcbdc66d6fcb8867d"} Jul 28 17:10:54.790379 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:54.790330 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xhvlq" podStartSLOduration=2.907800072 podStartE2EDuration="4.790312538s" totalImagesPullingTime="1.882512466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:54.788757525 +0000 UTC m=+92.130916890" watchObservedRunningTime="2026-07-28 17:10:54.790312538 +0000 UTC m=+92.132471932" Jul 28 17:10:55.301587 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:55.301472 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:55.578279 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:55.578247 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:55.679005 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:55.678905 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:55.775492 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:55.775449 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2c9e9cf-83af-4e03-9bdf-f06766702cc7","Type":"ContainerStarted","Data":"527f745dc06ce6439b9c67c888677ae881ab87594f56375784b97bddb5e311b0"} Jul 28 17:10:55.775834 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:55.775530 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2c9e9cf-83af-4e03-9bdf-f06766702cc7","Type":"ContainerStarted","Data":"bbd045f18b8d70b9fdc4e1a83b3074fa83aaf5ec37671d63ab92a2336e9dc11b"} Jul 28 17:10:55.775834 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:55.775561 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2c9e9cf-83af-4e03-9bdf-f06766702cc7","Type":"ContainerStarted","Data":"c4e92f3547108bf3f610e71e87036eb80a7de29678fe00e93c49ec3c01c0033e"} Jul 28 17:10:55.775834 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:55.775589 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2c9e9cf-83af-4e03-9bdf-f06766702cc7","Type":"ContainerStarted","Data":"95622da22fad285ff8b554e6fcd3a5bdfb7409ae835e64d8b0eaf333edcf2415"} Jul 28 17:10:55.775834 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:55.775620 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2c9e9cf-83af-4e03-9bdf-f06766702cc7","Type":"ContainerStarted","Data":"4c81dca1b034131077955bd5771ed3c1ee6b6376208d3d0d6fd272e15aca039e"} Jul 28 17:10:56.782428 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:56.782399 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2c9e9cf-83af-4e03-9bdf-f06766702cc7","Type":"ContainerStarted","Data":"6ab431f7960cace9f08b9cad144997008b7a738bad3db3fc811b65cef7cf3527"} Jul 28 17:10:56.815531 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:56.815469 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.509157742 podStartE2EDuration="5.815447339s" totalImagesPullingTime="3.284459752s" totalInitContainerRuntime="21.829845ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:56.813659983 +0000 UTC m=+94.155819327" watchObservedRunningTime="2026-07-28 17:10:56.815447339 +0000 UTC m=+94.157606692" Jul 28 17:10:56.824998 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:56.824967 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:57.479491 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:57.479454 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:57.539506 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:57.539475 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:10:58.310889 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:10:58.310858 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:01.136489 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:01.136458 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:01.238833 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:01.238799 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:06.409569 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:06.409534 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64bcd65589-h7w6m"] Jul 28 17:11:06.550601 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:06.550575 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:06.631023 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:06.630985 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:07.308185 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:07.308142 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:08.669851 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:08.669821 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mp4jl" Jul 28 17:11:12.476293 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:12.476264 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:12.543881 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:12.543849 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:12.827337 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:12.827291 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f84bff75b-flcv4" podUID="06b96724-e607-4a21-ace1-05b0655d4cac" containerName="console" containerID="cri-o://646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b" gracePeriod=15 Jul 28 17:11:13.592942 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.592894 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:11:13.666427 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.666396 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-oauth-config\") pod \"06b96724-e607-4a21-ace1-05b0655d4cac\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " Jul 28 17:11:13.666599 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.666448 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-console-config\") pod \"06b96724-e607-4a21-ace1-05b0655d4cac\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " Jul 28 17:11:13.666599 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.666473 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-serving-cert\") pod \"06b96724-e607-4a21-ace1-05b0655d4cac\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " Jul 28 17:11:13.666599 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.666488 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-service-ca\") pod \"06b96724-e607-4a21-ace1-05b0655d4cac\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " Jul 28 17:11:13.666599 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.666516 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-oauth-serving-cert\") pod \"06b96724-e607-4a21-ace1-05b0655d4cac\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " Jul 28 17:11:13.666599 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.666573 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvzl6\" (UniqueName: \"kubernetes.io/projected/06b96724-e607-4a21-ace1-05b0655d4cac-kube-api-access-kvzl6\") pod \"06b96724-e607-4a21-ace1-05b0655d4cac\" (UID: \"06b96724-e607-4a21-ace1-05b0655d4cac\") " Jul 28 17:11:13.666968 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.666914 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-service-ca" (OuterVolumeSpecName: "service-ca") pod "06b96724-e607-4a21-ace1-05b0655d4cac" (UID: "06b96724-e607-4a21-ace1-05b0655d4cac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:11:13.666968 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.666951 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "06b96724-e607-4a21-ace1-05b0655d4cac" (UID: "06b96724-e607-4a21-ace1-05b0655d4cac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:11:13.667150 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.666953 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-console-config" (OuterVolumeSpecName: "console-config") pod "06b96724-e607-4a21-ace1-05b0655d4cac" (UID: "06b96724-e607-4a21-ace1-05b0655d4cac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:11:13.668837 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.668810 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b96724-e607-4a21-ace1-05b0655d4cac-kube-api-access-kvzl6" (OuterVolumeSpecName: "kube-api-access-kvzl6") pod "06b96724-e607-4a21-ace1-05b0655d4cac" (UID: "06b96724-e607-4a21-ace1-05b0655d4cac"). InnerVolumeSpecName "kube-api-access-kvzl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:11:13.672865 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.672834 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "06b96724-e607-4a21-ace1-05b0655d4cac" (UID: "06b96724-e607-4a21-ace1-05b0655d4cac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:11:13.672941 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.672872 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "06b96724-e607-4a21-ace1-05b0655d4cac" (UID: "06b96724-e607-4a21-ace1-05b0655d4cac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:11:13.767425 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.767391 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:13.767425 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.767422 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-service-ca\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:13.767425 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.767431 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-oauth-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:13.767641 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.767440 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvzl6\" (UniqueName: \"kubernetes.io/projected/06b96724-e607-4a21-ace1-05b0655d4cac-kube-api-access-kvzl6\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:13.767641 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.767450 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b96724-e607-4a21-ace1-05b0655d4cac-console-oauth-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:13.767641 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.767458 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b96724-e607-4a21-ace1-05b0655d4cac-console-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:13.847451 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.847419 2582 generic.go:356] "Generic (PLEG): container finished" podID="06b96724-e607-4a21-ace1-05b0655d4cac" containerID="646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b" exitCode=0 Jul 28 17:11:13.847617 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.847458 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f84bff75b-flcv4" Jul 28 17:11:13.847617 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.847499 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f84bff75b-flcv4" event={"ID":"06b96724-e607-4a21-ace1-05b0655d4cac","Type":"ContainerDied","Data":"646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b"} Jul 28 17:11:13.847617 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.847570 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f84bff75b-flcv4" event={"ID":"06b96724-e607-4a21-ace1-05b0655d4cac","Type":"ContainerDied","Data":"c8114a0aef4494739157cb1dd45852430bbc296654f822e3b747270b0e6f2f0a"} Jul 28 17:11:13.847617 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.847592 2582 scope.go:117] "RemoveContainer" containerID="646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b" Jul 28 17:11:13.856757 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.856742 2582 scope.go:117] "RemoveContainer" containerID="646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b" Jul 28 17:11:13.857095 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:11:13.857058 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b\": container with ID starting with 646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b not found: ID does not exist" containerID="646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b" Jul 28 17:11:13.857169 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.857098 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b"} err="failed to get container status \"646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b\": rpc error: code = NotFound desc = could not find container \"646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b\": container with ID starting with 646ea2b4bbefbeef4ad99fad0c0ddbe1efcfcbc8a208203458cbb92173155b8b not found: ID does not exist" Jul 28 17:11:13.869590 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.869567 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f84bff75b-flcv4"] Jul 28 17:11:13.873908 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:13.873888 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f84bff75b-flcv4"] Jul 28 17:11:15.259879 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:15.259845 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06b96724-e607-4a21-ace1-05b0655d4cac" path="/var/lib/kubelet/pods/06b96724-e607-4a21-ace1-05b0655d4cac/volumes" Jul 28 17:11:18.158866 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:18.158818 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s424p_c62ff42b-7e5d-4310-bb19-00a15b991f42/serve-healthcheck-canary/0.log" Jul 28 17:11:22.559250 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:22.559217 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:22.671179 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:22.671150 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:22.754212 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:22.754167 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:27.474822 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:27.474772 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:27.542847 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:27.542815 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:11:31.432295 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.432235 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64bcd65589-h7w6m" podUID="ba89fea3-4472-4d44-9538-e93fa5733eb3" containerName="console" containerID="cri-o://85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a" gracePeriod=15 Jul 28 17:11:31.689302 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.689250 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:11:31.818265 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818233 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-config\") pod \"ba89fea3-4472-4d44-9538-e93fa5733eb3\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " Jul 28 17:11:31.818430 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818282 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-trusted-ca-bundle\") pod \"ba89fea3-4472-4d44-9538-e93fa5733eb3\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " Jul 28 17:11:31.818430 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818310 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-oauth-serving-cert\") pod \"ba89fea3-4472-4d44-9538-e93fa5733eb3\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " Jul 28 17:11:31.818430 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818330 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxglp\" (UniqueName: \"kubernetes.io/projected/ba89fea3-4472-4d44-9538-e93fa5733eb3-kube-api-access-nxglp\") pod \"ba89fea3-4472-4d44-9538-e93fa5733eb3\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " Jul 28 17:11:31.818572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818443 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-serving-cert\") pod \"ba89fea3-4472-4d44-9538-e93fa5733eb3\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " Jul 28 17:11:31.818572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818507 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-service-ca\") pod \"ba89fea3-4472-4d44-9538-e93fa5733eb3\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " Jul 28 17:11:31.818673 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818608 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-config" (OuterVolumeSpecName: "console-config") pod "ba89fea3-4472-4d44-9538-e93fa5733eb3" (UID: "ba89fea3-4472-4d44-9538-e93fa5733eb3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:11:31.818673 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818624 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-oauth-config\") pod \"ba89fea3-4472-4d44-9538-e93fa5733eb3\" (UID: \"ba89fea3-4472-4d44-9538-e93fa5733eb3\") " Jul 28 17:11:31.818789 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818753 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba89fea3-4472-4d44-9538-e93fa5733eb3" (UID: "ba89fea3-4472-4d44-9538-e93fa5733eb3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:11:31.818857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818789 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba89fea3-4472-4d44-9538-e93fa5733eb3" (UID: "ba89fea3-4472-4d44-9538-e93fa5733eb3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:11:31.818857 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818845 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba89fea3-4472-4d44-9538-e93fa5733eb3" (UID: "ba89fea3-4472-4d44-9538-e93fa5733eb3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:11:31.818990 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818916 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:31.818990 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818951 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-trusted-ca-bundle\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:31.818990 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818966 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-oauth-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:31.818990 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.818977 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba89fea3-4472-4d44-9538-e93fa5733eb3-service-ca\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:31.820520 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.820489 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba89fea3-4472-4d44-9538-e93fa5733eb3-kube-api-access-nxglp" (OuterVolumeSpecName: "kube-api-access-nxglp") pod "ba89fea3-4472-4d44-9538-e93fa5733eb3" (UID: "ba89fea3-4472-4d44-9538-e93fa5733eb3"). InnerVolumeSpecName "kube-api-access-nxglp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:11:31.820520 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.820507 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba89fea3-4472-4d44-9538-e93fa5733eb3" (UID: "ba89fea3-4472-4d44-9538-e93fa5733eb3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:11:31.820660 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.820533 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba89fea3-4472-4d44-9538-e93fa5733eb3" (UID: "ba89fea3-4472-4d44-9538-e93fa5733eb3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:11:31.916872 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.916838 2582 generic.go:356] "Generic (PLEG): container finished" podID="ba89fea3-4472-4d44-9538-e93fa5733eb3" containerID="85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a" exitCode=0 Jul 28 17:11:31.917070 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.916883 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64bcd65589-h7w6m" Jul 28 17:11:31.917070 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.916885 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcd65589-h7w6m" event={"ID":"ba89fea3-4472-4d44-9538-e93fa5733eb3","Type":"ContainerDied","Data":"85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a"} Jul 28 17:11:31.917070 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.916948 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64bcd65589-h7w6m" event={"ID":"ba89fea3-4472-4d44-9538-e93fa5733eb3","Type":"ContainerDied","Data":"d901865e098602df79fc0490f6d7721ad6768594b64684224dc2fd064cac666a"} Jul 28 17:11:31.917070 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.916975 2582 scope.go:117] "RemoveContainer" containerID="85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a" Jul 28 17:11:31.920315 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.920294 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxglp\" (UniqueName: \"kubernetes.io/projected/ba89fea3-4472-4d44-9538-e93fa5733eb3-kube-api-access-nxglp\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:31.920378 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.920322 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:31.920378 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.920338 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba89fea3-4472-4d44-9538-e93fa5733eb3-console-oauth-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:11:31.925609 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.925587 2582 scope.go:117] "RemoveContainer" containerID="85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a" Jul 28 17:11:31.925855 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:11:31.925836 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a\": container with ID starting with 85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a not found: ID does not exist" containerID="85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a" Jul 28 17:11:31.925914 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.925862 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a"} err="failed to get container status \"85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a\": rpc error: code = NotFound desc = could not find container \"85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a\": container with ID starting with 85f3cf91e5764d6674ce8c5784b340280a3f3da1c1022783bb6d973ba385159a not found: ID does not exist" Jul 28 17:11:31.940369 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.940313 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64bcd65589-h7w6m"] Jul 28 17:11:31.944618 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:31.944600 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64bcd65589-h7w6m"] Jul 28 17:11:33.260478 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:33.260438 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba89fea3-4472-4d44-9538-e93fa5733eb3" path="/var/lib/kubelet/pods/ba89fea3-4472-4d44-9538-e93fa5733eb3/volumes" Jul 28 17:11:48.771149 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:11:48.771118 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:09.848473 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:09.848411 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:10.610655 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:10.610624 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:15.070283 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.070207 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-678cfff567-xwt6r"] Jul 28 17:12:15.071157 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.071134 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b96724-e607-4a21-ace1-05b0655d4cac" containerName="console" Jul 28 17:12:15.071305 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.071279 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b96724-e607-4a21-ace1-05b0655d4cac" containerName="console" Jul 28 17:12:15.071422 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.071321 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba89fea3-4472-4d44-9538-e93fa5733eb3" containerName="console" Jul 28 17:12:15.071422 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.071331 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba89fea3-4472-4d44-9538-e93fa5733eb3" containerName="console" Jul 28 17:12:15.071422 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.071401 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b96724-e607-4a21-ace1-05b0655d4cac" containerName="console" Jul 28 17:12:15.071569 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.071434 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba89fea3-4472-4d44-9538-e93fa5733eb3" containerName="console" Jul 28 17:12:15.073296 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.073281 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.081975 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.081952 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 17:12:15.082232 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.082217 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 17:12:15.082671 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.082653 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 17:12:15.082935 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.082902 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p6ctq\"" Jul 28 17:12:15.083028 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.082951 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 17:12:15.084197 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.084180 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 17:12:15.117726 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.117692 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-678cfff567-xwt6r"] Jul 28 17:12:15.123650 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.123622 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 17:12:15.130204 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.130183 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-telemeter-client-tls\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.130323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.130219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-federate-client-tls\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.130323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.130242 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-metrics-client-ca\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.130393 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.130321 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm2fm\" (UniqueName: \"kubernetes.io/projected/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-kube-api-access-tm2fm\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.130393 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.130363 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.130460 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.130418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.130460 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.130448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-secret-telemeter-client\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.130532 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.130471 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-serving-certs-ca-bundle\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.231388 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.231359 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-metrics-client-ca\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.231556 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.231398 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm2fm\" (UniqueName: \"kubernetes.io/projected/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-kube-api-access-tm2fm\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.231556 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.231429 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.231632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.231556 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.231632 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.231615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-secret-telemeter-client\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.231710 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.231660 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-serving-certs-ca-bundle\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.231758 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.231711 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-telemeter-client-tls\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.231812 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.231760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-federate-client-tls\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.232321 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.232294 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-metrics-client-ca\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.232514 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.232434 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-serving-certs-ca-bundle\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.232514 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.232452 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.233999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.233973 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.234097 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.234052 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-secret-telemeter-client\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.234155 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.234107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-telemeter-client-tls\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.234211 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.234194 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-federate-client-tls\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.244251 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.244227 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm2fm\" (UniqueName: \"kubernetes.io/projected/f83f317c-7fcd-4ff0-9c6a-310cca5e2da6-kube-api-access-tm2fm\") pod \"telemeter-client-678cfff567-xwt6r\" (UID: \"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6\") " pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.384312 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.384231 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" Jul 28 17:12:15.543258 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:15.543235 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-678cfff567-xwt6r"] Jul 28 17:12:15.544833 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:12:15.544807 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83f317c_7fcd_4ff0_9c6a_310cca5e2da6.slice/crio-51cd512ec68d4bb87038c01106024ea481e2a4244bec7626ff48582447f3b965 WatchSource:0}: Error finding container 51cd512ec68d4bb87038c01106024ea481e2a4244bec7626ff48582447f3b965: Status 404 returned error can't find the container with id 51cd512ec68d4bb87038c01106024ea481e2a4244bec7626ff48582447f3b965 Jul 28 17:12:16.073386 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:16.073351 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" event={"ID":"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6","Type":"ContainerStarted","Data":"51cd512ec68d4bb87038c01106024ea481e2a4244bec7626ff48582447f3b965"} Jul 28 17:12:18.081885 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:18.081845 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" event={"ID":"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6","Type":"ContainerStarted","Data":"5a259ea5168fca984d6fe10807dd4a46d9cb5a4602afe56877a33c2702afb4b4"} Jul 28 17:12:18.082288 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:18.081910 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" event={"ID":"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6","Type":"ContainerStarted","Data":"0a649d9cc41d63925fac85d54ff6b5ad62892f897e210878c046c7913f5e1124"} Jul 28 17:12:18.082288 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:18.081953 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" event={"ID":"f83f317c-7fcd-4ff0-9c6a-310cca5e2da6","Type":"ContainerStarted","Data":"2e9481d698365298e6b826e1e1ec8666d297a261282f1ed210c38b3874b9498a"} Jul 28 17:12:18.111110 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:18.111060 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-678cfff567-xwt6r" podStartSLOduration=2.178523384 podStartE2EDuration="4.111043423s" totalImagesPullingTime="1.932520039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:12:18.109873526 +0000 UTC m=+175.452032890" watchObservedRunningTime="2026-07-28 17:12:18.111043423 +0000 UTC m=+175.453202782" Jul 28 17:12:19.139831 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.139792 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5855b69497-crb6b"] Jul 28 17:12:19.142466 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.142443 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.149080 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.149053 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 17:12:19.149080 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.149072 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 17:12:19.149284 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.149098 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 17:12:19.149351 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.149330 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 17:12:19.149438 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.149422 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fcpnl\"" Jul 28 17:12:19.149516 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.149450 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 17:12:19.149678 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.149663 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 17:12:19.150678 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.150659 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 17:12:19.158424 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.158407 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 17:12:19.168035 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.167966 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5855b69497-crb6b"] Jul 28 17:12:19.269494 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.269463 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-service-ca\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.269494 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.269500 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-oauth-serving-cert\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.269713 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.269534 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-oauth-config\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.269713 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.269626 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-serving-cert\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.269713 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.269669 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-trusted-ca-bundle\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.269814 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.269710 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-config\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.269814 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.269767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4n2z\" (UniqueName: \"kubernetes.io/projected/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-kube-api-access-r4n2z\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.299711 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.299678 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:19.370694 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.370659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-serving-cert\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.370694 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.370696 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-trusted-ca-bundle\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.370992 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.370717 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-config\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.370992 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.370779 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4n2z\" (UniqueName: \"kubernetes.io/projected/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-kube-api-access-r4n2z\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.370992 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.370827 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-service-ca\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.370992 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.370850 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-oauth-serving-cert\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.370992 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.370907 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-oauth-config\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.371589 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.371560 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-config\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.371792 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.371741 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-service-ca\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.371900 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.371858 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-trusted-ca-bundle\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.371988 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.371899 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-oauth-serving-cert\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.373958 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.373896 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-serving-cert\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.374456 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.374432 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-oauth-config\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.386604 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.386576 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4n2z\" (UniqueName: \"kubernetes.io/projected/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-kube-api-access-r4n2z\") pod \"console-5855b69497-crb6b\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.418599 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.418515 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:19.451528 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.451495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:19.606723 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:19.606695 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5855b69497-crb6b"] Jul 28 17:12:19.610342 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:12:19.610300 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d9e4ba_d676_4e7a_a9a9_c8ebb651e4af.slice/crio-4eb88c999936a88ecf1f94fe50b6196e0a0ca387da0d091a82fbd48a32f88b99 WatchSource:0}: Error finding container 4eb88c999936a88ecf1f94fe50b6196e0a0ca387da0d091a82fbd48a32f88b99: Status 404 returned error can't find the container with id 4eb88c999936a88ecf1f94fe50b6196e0a0ca387da0d091a82fbd48a32f88b99 Jul 28 17:12:20.093138 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:20.093099 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5855b69497-crb6b" event={"ID":"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af","Type":"ContainerStarted","Data":"507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61"} Jul 28 17:12:20.093325 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:20.093160 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5855b69497-crb6b" event={"ID":"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af","Type":"ContainerStarted","Data":"4eb88c999936a88ecf1f94fe50b6196e0a0ca387da0d091a82fbd48a32f88b99"} Jul 28 17:12:20.114545 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:20.114490 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5855b69497-crb6b" podStartSLOduration=1.114474065 podStartE2EDuration="1.114474065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:12:20.113254575 +0000 UTC m=+177.455413929" watchObservedRunningTime="2026-07-28 17:12:20.114474065 +0000 UTC m=+177.456633416" Jul 28 17:12:25.434537 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:25.434502 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:25.518985 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:25.518953 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:27.171565 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:27.171522 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5855b69497-crb6b"] Jul 28 17:12:27.385349 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:27.385317 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:27.447052 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:27.446914 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:27.962010 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:27.961980 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:29.452168 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:29.452134 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:37.281498 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:37.281464 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:37.340579 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:37.340546 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:37.911919 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:37.911888 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:38.012578 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:38.012550 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:38.112477 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:38.112444 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:42.477418 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:42.477380 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:42.579114 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:42.579082 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:42.677682 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:42.677651 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:48.427037 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:48.427001 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:48.524091 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:48.524040 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:12:52.192813 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.192776 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5855b69497-crb6b" podUID="66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" containerName="console" containerID="cri-o://507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61" gracePeriod=15 Jul 28 17:12:52.434618 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.434594 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:52.454565 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.454488 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-serving-cert\") pod \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " Jul 28 17:12:52.454565 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.454523 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-trusted-ca-bundle\") pod \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " Jul 28 17:12:52.454565 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.454555 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-config\") pod \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " Jul 28 17:12:52.454825 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.454571 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-oauth-serving-cert\") pod \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " Jul 28 17:12:52.454825 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.454707 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4n2z\" (UniqueName: \"kubernetes.io/projected/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-kube-api-access-r4n2z\") pod \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " Jul 28 17:12:52.454825 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.454812 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-oauth-config\") pod \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " Jul 28 17:12:52.455006 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.454858 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-service-ca\") pod \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\" (UID: \"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af\") " Jul 28 17:12:52.455061 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.455039 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-config" (OuterVolumeSpecName: "console-config") pod "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" (UID: "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:12:52.455110 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.455051 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" (UID: "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:12:52.455110 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.455065 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" (UID: "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:12:52.455199 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.455159 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:12:52.455199 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.455179 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-oauth-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:12:52.455287 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.455249 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-trusted-ca-bundle\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:12:52.455395 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.455373 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-service-ca" (OuterVolumeSpecName: "service-ca") pod "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" (UID: "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:12:52.456794 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.456763 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" (UID: "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:12:52.456897 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.456840 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" (UID: "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:12:52.456961 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.456891 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-kube-api-access-r4n2z" (OuterVolumeSpecName: "kube-api-access-r4n2z") pod "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" (UID: "66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af"). InnerVolumeSpecName "kube-api-access-r4n2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:12:52.555774 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.555736 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4n2z\" (UniqueName: \"kubernetes.io/projected/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-kube-api-access-r4n2z\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:12:52.555774 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.555767 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-oauth-config\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:12:52.555774 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.555780 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-service-ca\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:12:52.556112 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:52.555789 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af-console-serving-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:12:53.215080 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.215042 2582 generic.go:356] "Generic (PLEG): container finished" podID="66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" containerID="507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61" exitCode=0 Jul 28 17:12:53.215517 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.215094 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5855b69497-crb6b" Jul 28 17:12:53.215517 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.215124 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5855b69497-crb6b" event={"ID":"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af","Type":"ContainerDied","Data":"507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61"} Jul 28 17:12:53.215517 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.215182 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5855b69497-crb6b" event={"ID":"66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af","Type":"ContainerDied","Data":"4eb88c999936a88ecf1f94fe50b6196e0a0ca387da0d091a82fbd48a32f88b99"} Jul 28 17:12:53.215517 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.215203 2582 scope.go:117] "RemoveContainer" containerID="507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61" Jul 28 17:12:53.223501 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.223483 2582 scope.go:117] "RemoveContainer" containerID="507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61" Jul 28 17:12:53.223778 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:12:53.223760 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61\": container with ID starting with 507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61 not found: ID does not exist" containerID="507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61" Jul 28 17:12:53.223836 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.223788 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61"} err="failed to get container status \"507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61\": rpc error: code = NotFound desc = could not find container \"507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61\": container with ID starting with 507dbd6af5ea7b3257ea5518b174ea08b022ebd0d6960704cdc98b78c64fdd61 not found: ID does not exist" Jul 28 17:12:53.236908 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.236872 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5855b69497-crb6b"] Jul 28 17:12:53.242601 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.242576 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5855b69497-crb6b"] Jul 28 17:12:53.259642 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:53.259605 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" path="/var/lib/kubelet/pods/66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af/volumes" Jul 28 17:12:59.184946 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:12:59.184883 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:13:45.647438 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:13:45.647344 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:13:45.747827 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:13:45.747799 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:13:46.029300 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:13:46.029251 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:13:46.144102 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:13:46.144070 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:13:46.246450 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:13:46.246418 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:08.128199 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:08.128162 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:08.225852 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:08.225825 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:13.667642 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.667606 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:13.940939 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.940820 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-p94f8"] Jul 28 17:14:13.941136 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.941123 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" containerName="console" Jul 28 17:14:13.941196 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.941138 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" containerName="console" Jul 28 17:14:13.941234 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.941205 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="66d9e4ba-d676-4e7a-a9a9-c8ebb651e4af" containerName="console" Jul 28 17:14:13.944064 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.944044 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:13.946877 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.946857 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8z9tr\"" Jul 28 17:14:13.947005 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.946860 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 28 17:14:13.948014 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.947995 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 28 17:14:13.948014 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.948011 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 28 17:14:13.948187 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.948048 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 28 17:14:13.948187 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.948068 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 28 17:14:13.948584 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.948566 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:13.953374 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.953345 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-p94f8"] Jul 28 17:14:13.981972 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.981946 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5zq2\" (UniqueName: \"kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-kube-api-access-n5zq2\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:13.982122 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.982000 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-cabundle0\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:13.982122 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:13.982088 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-certificates\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:14.082640 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.082605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-cabundle0\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:14.082849 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.082651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-certificates\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:14.082849 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.082696 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5zq2\" (UniqueName: \"kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-kube-api-access-n5zq2\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:14.082849 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:14:14.082823 2582 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 28 17:14:14.082849 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:14:14.082846 2582 secret.go:281] references non-existent secret key: ca.crt Jul 28 17:14:14.083110 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:14:14.082857 2582 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 28 17:14:14.083110 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:14:14.082872 2582 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-p94f8: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 28 17:14:14.083110 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:14:14.082949 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-certificates podName:26a42bb4-8fb1-4e60-9e7e-500e2274dd68 nodeName:}" failed. No retries permitted until 2026-07-28 17:14:14.582914611 +0000 UTC m=+291.925073960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-certificates") pod "keda-operator-77f648d694-p94f8" (UID: "26a42bb4-8fb1-4e60-9e7e-500e2274dd68") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 28 17:14:14.083415 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.083392 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-cabundle0\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:14.092222 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.092192 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5zq2\" (UniqueName: \"kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-kube-api-access-n5zq2\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:14.430912 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.430878 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:14.525956 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.525902 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:14.569612 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.569574 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv"] Jul 28 17:14:14.572649 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.572632 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.575415 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.575391 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 28 17:14:14.583321 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.583301 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv"] Jul 28 17:14:14.585775 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.585750 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-certificates\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:14.585896 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:14:14.585882 2582 secret.go:281] references non-existent secret key: ca.crt Jul 28 17:14:14.585976 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:14:14.585903 2582 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 28 17:14:14.585976 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:14:14.585915 2582 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-p94f8: references non-existent secret key: ca.crt Jul 28 17:14:14.586089 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:14:14.585998 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-certificates podName:26a42bb4-8fb1-4e60-9e7e-500e2274dd68 nodeName:}" failed. No retries permitted until 2026-07-28 17:14:15.585979744 +0000 UTC m=+292.928139093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-certificates") pod "keda-operator-77f648d694-p94f8" (UID: "26a42bb4-8fb1-4e60-9e7e-500e2274dd68") : references non-existent secret key: ca.crt Jul 28 17:14:14.686838 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.686739 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26xcf\" (UniqueName: \"kubernetes.io/projected/b633681f-4f21-444e-a542-94adb03c55b9-kube-api-access-26xcf\") pod \"keda-metrics-apiserver-55557df8c-5xdgv\" (UID: \"b633681f-4f21-444e-a542-94adb03c55b9\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.687323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.686849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b633681f-4f21-444e-a542-94adb03c55b9-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-5xdgv\" (UID: \"b633681f-4f21-444e-a542-94adb03c55b9\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.687323 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.686869 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b633681f-4f21-444e-a542-94adb03c55b9-certificates\") pod \"keda-metrics-apiserver-55557df8c-5xdgv\" (UID: \"b633681f-4f21-444e-a542-94adb03c55b9\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.787750 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.787722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b633681f-4f21-444e-a542-94adb03c55b9-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-5xdgv\" (UID: \"b633681f-4f21-444e-a542-94adb03c55b9\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.787750 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.787754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b633681f-4f21-444e-a542-94adb03c55b9-certificates\") pod \"keda-metrics-apiserver-55557df8c-5xdgv\" (UID: \"b633681f-4f21-444e-a542-94adb03c55b9\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.787966 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.787778 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26xcf\" (UniqueName: \"kubernetes.io/projected/b633681f-4f21-444e-a542-94adb03c55b9-kube-api-access-26xcf\") pod \"keda-metrics-apiserver-55557df8c-5xdgv\" (UID: \"b633681f-4f21-444e-a542-94adb03c55b9\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.788129 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.788107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b633681f-4f21-444e-a542-94adb03c55b9-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-5xdgv\" (UID: \"b633681f-4f21-444e-a542-94adb03c55b9\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.790678 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.790651 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b633681f-4f21-444e-a542-94adb03c55b9-certificates\") pod \"keda-metrics-apiserver-55557df8c-5xdgv\" (UID: \"b633681f-4f21-444e-a542-94adb03c55b9\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.799103 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.799080 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-w8zll"] Jul 28 17:14:14.802301 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.802282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:14.803329 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.803299 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26xcf\" (UniqueName: \"kubernetes.io/projected/b633681f-4f21-444e-a542-94adb03c55b9-kube-api-access-26xcf\") pod \"keda-metrics-apiserver-55557df8c-5xdgv\" (UID: \"b633681f-4f21-444e-a542-94adb03c55b9\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.805464 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.805443 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 28 17:14:14.812410 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.812379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:14.812865 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.812843 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-w8zll"] Jul 28 17:14:14.882953 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.882904 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:14.889135 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.889109 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11a79adb-5b22-41d3-a166-bd9c2b89755d-certificates\") pod \"keda-admission-56f9798bb4-w8zll\" (UID: \"11a79adb-5b22-41d3-a166-bd9c2b89755d\") " pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:14.889291 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.889158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sjq8\" (UniqueName: \"kubernetes.io/projected/11a79adb-5b22-41d3-a166-bd9c2b89755d-kube-api-access-7sjq8\") pod \"keda-admission-56f9798bb4-w8zll\" (UID: \"11a79adb-5b22-41d3-a166-bd9c2b89755d\") " pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:14.907795 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.907771 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:14.990469 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.990440 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11a79adb-5b22-41d3-a166-bd9c2b89755d-certificates\") pod \"keda-admission-56f9798bb4-w8zll\" (UID: \"11a79adb-5b22-41d3-a166-bd9c2b89755d\") " pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:14.990623 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.990494 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sjq8\" (UniqueName: \"kubernetes.io/projected/11a79adb-5b22-41d3-a166-bd9c2b89755d-kube-api-access-7sjq8\") pod \"keda-admission-56f9798bb4-w8zll\" (UID: \"11a79adb-5b22-41d3-a166-bd9c2b89755d\") " pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:14.994427 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:14.994403 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/11a79adb-5b22-41d3-a166-bd9c2b89755d-certificates\") pod \"keda-admission-56f9798bb4-w8zll\" (UID: \"11a79adb-5b22-41d3-a166-bd9c2b89755d\") " pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:15.000301 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.000244 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sjq8\" (UniqueName: \"kubernetes.io/projected/11a79adb-5b22-41d3-a166-bd9c2b89755d-kube-api-access-7sjq8\") pod \"keda-admission-56f9798bb4-w8zll\" (UID: \"11a79adb-5b22-41d3-a166-bd9c2b89755d\") " pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:15.011172 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.011147 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:15.033166 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.033145 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv"] Jul 28 17:14:15.035484 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:14:15.035456 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb633681f_4f21_444e_a542_94adb03c55b9.slice/crio-528dc510359e4d8f3e6e9b2f99a6c48d74ae69d4c8813003f47508a355fb2f31 WatchSource:0}: Error finding container 528dc510359e4d8f3e6e9b2f99a6c48d74ae69d4c8813003f47508a355fb2f31: Status 404 returned error can't find the container with id 528dc510359e4d8f3e6e9b2f99a6c48d74ae69d4c8813003f47508a355fb2f31 Jul 28 17:14:15.124175 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.124139 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:15.270466 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.270437 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-w8zll"] Jul 28 17:14:15.275037 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:14:15.275006 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a79adb_5b22_41d3_a166_bd9c2b89755d.slice/crio-3f2be62ab639134c5f3ed9e73c83e9f6272a5a50d58e2f048199e867f46d52cd WatchSource:0}: Error finding container 3f2be62ab639134c5f3ed9e73c83e9f6272a5a50d58e2f048199e867f46d52cd: Status 404 returned error can't find the container with id 3f2be62ab639134c5f3ed9e73c83e9f6272a5a50d58e2f048199e867f46d52cd Jul 28 17:14:15.514105 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.514071 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-w8zll" event={"ID":"11a79adb-5b22-41d3-a166-bd9c2b89755d","Type":"ContainerStarted","Data":"3f2be62ab639134c5f3ed9e73c83e9f6272a5a50d58e2f048199e867f46d52cd"} Jul 28 17:14:15.515142 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.515123 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" event={"ID":"b633681f-4f21-444e-a542-94adb03c55b9","Type":"ContainerStarted","Data":"528dc510359e4d8f3e6e9b2f99a6c48d74ae69d4c8813003f47508a355fb2f31"} Jul 28 17:14:15.595412 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.595376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-certificates\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:15.597972 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.597906 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/26a42bb4-8fb1-4e60-9e7e-500e2274dd68-certificates\") pod \"keda-operator-77f648d694-p94f8\" (UID: \"26a42bb4-8fb1-4e60-9e7e-500e2274dd68\") " pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:15.755257 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.755224 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:15.938909 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:15.938865 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-p94f8"] Jul 28 17:14:15.942524 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:14:15.942491 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a42bb4_8fb1_4e60_9e7e_500e2274dd68.slice/crio-0ec8f765fc4d5fdb84ef23d0fd638bd44eec77d3ddd981ca0e7e67879beb553a WatchSource:0}: Error finding container 0ec8f765fc4d5fdb84ef23d0fd638bd44eec77d3ddd981ca0e7e67879beb553a: Status 404 returned error can't find the container with id 0ec8f765fc4d5fdb84ef23d0fd638bd44eec77d3ddd981ca0e7e67879beb553a Jul 28 17:14:16.477805 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:16.477749 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:16.522634 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:16.522596 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-p94f8" event={"ID":"26a42bb4-8fb1-4e60-9e7e-500e2274dd68","Type":"ContainerStarted","Data":"0ec8f765fc4d5fdb84ef23d0fd638bd44eec77d3ddd981ca0e7e67879beb553a"} Jul 28 17:14:18.534579 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:18.534546 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" event={"ID":"b633681f-4f21-444e-a542-94adb03c55b9","Type":"ContainerStarted","Data":"748f5e303c87379e93322e5e831bcf5fd4afb80c5481d9b0c2123444d2c4c3e1"} Jul 28 17:14:18.535103 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:18.534635 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:18.562574 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:18.562515 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" podStartSLOduration=1.685872928 podStartE2EDuration="4.562492351s" totalImagesPullingTime="2.876619423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:14:18.560820057 +0000 UTC m=+295.902979409" watchObservedRunningTime="2026-07-28 17:14:18.562492351 +0000 UTC m=+295.904651706" Jul 28 17:14:19.540361 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:19.540318 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-w8zll" event={"ID":"11a79adb-5b22-41d3-a166-bd9c2b89755d","Type":"ContainerStarted","Data":"359decf09bd7d1c37e15d3a558e8cb243f5792621a5c59825d335c28d7f240d3"} Jul 28 17:14:19.558394 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:19.558345 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-w8zll" podStartSLOduration=1.943488771 podStartE2EDuration="5.55832378s" totalImagesPullingTime="3.614835009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:14:19.557277791 +0000 UTC m=+296.899437141" watchObservedRunningTime="2026-07-28 17:14:19.55832378 +0000 UTC m=+296.900483134" Jul 28 17:14:20.545223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:20.545185 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:21.550453 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:21.550417 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-p94f8" event={"ID":"26a42bb4-8fb1-4e60-9e7e-500e2274dd68","Type":"ContainerStarted","Data":"628ccdc4b159b483e364270c079b98c24a2e2e750b1f60ad5f1bb05c2230436d"} Jul 28 17:14:21.550868 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:21.550497 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:14:21.570100 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:21.570049 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-p94f8" podStartSLOduration=3.699478468 podStartE2EDuration="8.570030733s" totalImagesPullingTime="4.870552265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:14:21.569365346 +0000 UTC m=+298.911524698" watchObservedRunningTime="2026-07-28 17:14:21.570030733 +0000 UTC m=+298.912190084" Jul 28 17:14:23.049124 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:23.049099 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 17:14:29.545240 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:29.545212 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-5xdgv" Jul 28 17:14:30.225133 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:30.225103 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:30.300265 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:30.300232 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:14:41.553240 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:41.553205 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-w8zll" Jul 28 17:14:42.556944 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:14:42.556894 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-p94f8" Jul 28 17:15:32.493342 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.493264 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:15:32.561352 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.561323 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-srmrf"] Jul 28 17:15:32.570362 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.570340 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:32.572822 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.572797 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 28 17:15:32.573123 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.573106 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 17:15:32.574656 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.574598 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-ncsjq\"" Jul 28 17:15:32.574777 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.574703 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 17:15:32.577001 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.576978 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-srmrf"] Jul 28 17:15:32.578837 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.578180 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:15:32.604866 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.604841 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-zcqgj"] Jul 28 17:15:32.607254 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.607235 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:32.609789 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.609771 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vxh6m\"" Jul 28 17:15:32.609898 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.609813 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 28 17:15:32.618965 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.618916 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-zcqgj"] Jul 28 17:15:32.634228 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.634204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn9fs\" (UniqueName: \"kubernetes.io/projected/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-kube-api-access-jn9fs\") pod \"kserve-controller-manager-cd4d44c67-srmrf\" (UID: \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\") " pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:32.634330 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.634235 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-cert\") pod \"kserve-controller-manager-cd4d44c67-srmrf\" (UID: \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\") " pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:32.661104 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.661077 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:15:32.735411 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.735385 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t57ld\" (UniqueName: \"kubernetes.io/projected/aaaf7189-4d14-4e93-b39b-b96dc77fc866-kube-api-access-t57ld\") pod \"seaweedfs-64568bcd49-zcqgj\" (UID: \"aaaf7189-4d14-4e93-b39b-b96dc77fc866\") " pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:32.735532 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.735420 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn9fs\" (UniqueName: \"kubernetes.io/projected/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-kube-api-access-jn9fs\") pod \"kserve-controller-manager-cd4d44c67-srmrf\" (UID: \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\") " pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:32.735532 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.735440 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aaaf7189-4d14-4e93-b39b-b96dc77fc866-data\") pod \"seaweedfs-64568bcd49-zcqgj\" (UID: \"aaaf7189-4d14-4e93-b39b-b96dc77fc866\") " pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:32.735532 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.735466 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-cert\") pod \"kserve-controller-manager-cd4d44c67-srmrf\" (UID: \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\") " pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:32.735649 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:15:32.735553 2582 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 28 17:15:32.735649 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:15:32.735606 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-cert podName:73145cf6-cd4d-4201-a0a4-4c60ccd908b3 nodeName:}" failed. No retries permitted until 2026-07-28 17:15:33.235592576 +0000 UTC m=+370.577751904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-cert") pod "kserve-controller-manager-cd4d44c67-srmrf" (UID: "73145cf6-cd4d-4201-a0a4-4c60ccd908b3") : secret "kserve-webhook-server-cert" not found Jul 28 17:15:32.746965 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.746894 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn9fs\" (UniqueName: \"kubernetes.io/projected/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-kube-api-access-jn9fs\") pod \"kserve-controller-manager-cd4d44c67-srmrf\" (UID: \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\") " pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:32.761056 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.761037 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:15:32.836070 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.836036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t57ld\" (UniqueName: \"kubernetes.io/projected/aaaf7189-4d14-4e93-b39b-b96dc77fc866-kube-api-access-t57ld\") pod \"seaweedfs-64568bcd49-zcqgj\" (UID: \"aaaf7189-4d14-4e93-b39b-b96dc77fc866\") " pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:32.836070 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.836077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aaaf7189-4d14-4e93-b39b-b96dc77fc866-data\") pod \"seaweedfs-64568bcd49-zcqgj\" (UID: \"aaaf7189-4d14-4e93-b39b-b96dc77fc866\") " pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:32.836421 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.836388 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aaaf7189-4d14-4e93-b39b-b96dc77fc866-data\") pod \"seaweedfs-64568bcd49-zcqgj\" (UID: \"aaaf7189-4d14-4e93-b39b-b96dc77fc866\") " pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:32.845822 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.845794 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t57ld\" (UniqueName: \"kubernetes.io/projected/aaaf7189-4d14-4e93-b39b-b96dc77fc866-kube-api-access-t57ld\") pod \"seaweedfs-64568bcd49-zcqgj\" (UID: \"aaaf7189-4d14-4e93-b39b-b96dc77fc866\") " pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:32.861459 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.861434 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:15:32.915626 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:32.915595 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:33.062272 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.062250 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-zcqgj"] Jul 28 17:15:33.064736 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:15:33.064710 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaaf7189_4d14_4e93_b39b_b96dc77fc866.slice/crio-e6cccf385007fec8536a4326b5a9daaa94ef984cd255b2a627135fbce0c9fc08 WatchSource:0}: Error finding container e6cccf385007fec8536a4326b5a9daaa94ef984cd255b2a627135fbce0c9fc08: Status 404 returned error can't find the container with id e6cccf385007fec8536a4326b5a9daaa94ef984cd255b2a627135fbce0c9fc08 Jul 28 17:15:33.066143 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.066126 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:15:33.239532 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.239504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-cert\") pod \"kserve-controller-manager-cd4d44c67-srmrf\" (UID: \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\") " pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:33.241895 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.241866 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-cert\") pod \"kserve-controller-manager-cd4d44c67-srmrf\" (UID: \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\") " pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:33.245897 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.245875 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:15:33.347786 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.347685 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:15:33.482086 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.482052 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:33.610269 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.610197 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-srmrf"] Jul 28 17:15:33.613129 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:15:33.613101 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73145cf6_cd4d_4201_a0a4_4c60ccd908b3.slice/crio-491cb6bf2f5d4acf9708f4fa2e5925e1de0562f6e9548c7bd9f1bc7979dbb88e WatchSource:0}: Error finding container 491cb6bf2f5d4acf9708f4fa2e5925e1de0562f6e9548c7bd9f1bc7979dbb88e: Status 404 returned error can't find the container with id 491cb6bf2f5d4acf9708f4fa2e5925e1de0562f6e9548c7bd9f1bc7979dbb88e Jul 28 17:15:33.832674 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.832641 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" event={"ID":"73145cf6-cd4d-4201-a0a4-4c60ccd908b3","Type":"ContainerStarted","Data":"491cb6bf2f5d4acf9708f4fa2e5925e1de0562f6e9548c7bd9f1bc7979dbb88e"} Jul 28 17:15:33.833849 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:33.833819 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-zcqgj" event={"ID":"aaaf7189-4d14-4e93-b39b-b96dc77fc866","Type":"ContainerStarted","Data":"e6cccf385007fec8536a4326b5a9daaa94ef984cd255b2a627135fbce0c9fc08"} Jul 28 17:15:37.851647 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:37.851606 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-zcqgj" event={"ID":"aaaf7189-4d14-4e93-b39b-b96dc77fc866","Type":"ContainerStarted","Data":"42925facde9ec78d9f1c41054b07c97a5467567060543fceaed9f05e6dcfd1ad"} Jul 28 17:15:37.852086 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:37.851705 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:37.853018 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:37.852994 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" event={"ID":"73145cf6-cd4d-4201-a0a4-4c60ccd908b3","Type":"ContainerStarted","Data":"1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204"} Jul 28 17:15:37.853148 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:37.853133 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:15:37.872257 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:37.872214 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-zcqgj" podStartSLOduration=1.901407618 podStartE2EDuration="5.872198204s" totalImagesPullingTime="3.970790586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:15:37.869732078 +0000 UTC m=+375.211891454" watchObservedRunningTime="2026-07-28 17:15:37.872198204 +0000 UTC m=+375.214357554" Jul 28 17:15:37.889495 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:37.889453 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" podStartSLOduration=2.533612143 podStartE2EDuration="5.889440921s" totalImagesPullingTime="3.355828778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:15:37.88837478 +0000 UTC m=+375.230534132" watchObservedRunningTime="2026-07-28 17:15:37.889440921 +0000 UTC m=+375.231600272" Jul 28 17:15:43.859538 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:43.859508 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-zcqgj" Jul 28 17:15:53.977156 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:15:53.977120 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:06.040015 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:06.039981 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:06.140270 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:06.140235 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:08.022666 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:08.022621 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:08.124267 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:08.124213 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:08.863195 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:08.863167 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:16:15.170520 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.170487 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-srmrf"] Jul 28 17:16:15.170950 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.170685 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" podUID="73145cf6-cd4d-4201-a0a4-4c60ccd908b3" containerName="manager" containerID="cri-o://1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204" gracePeriod=10 Jul 28 17:16:15.202419 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.202391 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-5gkvs"] Jul 28 17:16:15.204720 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.204699 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:15.247234 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.247209 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-5gkvs"] Jul 28 17:16:15.265858 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.265827 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b9kg\" (UniqueName: \"kubernetes.io/projected/545f8784-9a65-4a7f-bdb1-048951485b46-kube-api-access-4b9kg\") pod \"kserve-controller-manager-cd4d44c67-5gkvs\" (UID: \"545f8784-9a65-4a7f-bdb1-048951485b46\") " pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:15.265996 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.265870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/545f8784-9a65-4a7f-bdb1-048951485b46-cert\") pod \"kserve-controller-manager-cd4d44c67-5gkvs\" (UID: \"545f8784-9a65-4a7f-bdb1-048951485b46\") " pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:15.366911 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.366879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b9kg\" (UniqueName: \"kubernetes.io/projected/545f8784-9a65-4a7f-bdb1-048951485b46-kube-api-access-4b9kg\") pod \"kserve-controller-manager-cd4d44c67-5gkvs\" (UID: \"545f8784-9a65-4a7f-bdb1-048951485b46\") " pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:15.367064 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.366957 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/545f8784-9a65-4a7f-bdb1-048951485b46-cert\") pod \"kserve-controller-manager-cd4d44c67-5gkvs\" (UID: \"545f8784-9a65-4a7f-bdb1-048951485b46\") " pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:15.369540 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.369510 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/545f8784-9a65-4a7f-bdb1-048951485b46-cert\") pod \"kserve-controller-manager-cd4d44c67-5gkvs\" (UID: \"545f8784-9a65-4a7f-bdb1-048951485b46\") " pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:15.377153 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.377128 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b9kg\" (UniqueName: \"kubernetes.io/projected/545f8784-9a65-4a7f-bdb1-048951485b46-kube-api-access-4b9kg\") pod \"kserve-controller-manager-cd4d44c67-5gkvs\" (UID: \"545f8784-9a65-4a7f-bdb1-048951485b46\") " pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:15.417715 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.417694 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:16:15.467753 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.467691 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn9fs\" (UniqueName: \"kubernetes.io/projected/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-kube-api-access-jn9fs\") pod \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\" (UID: \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\") " Jul 28 17:16:15.467753 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.467748 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-cert\") pod \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\" (UID: \"73145cf6-cd4d-4201-a0a4-4c60ccd908b3\") " Jul 28 17:16:15.469830 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.469796 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-cert" (OuterVolumeSpecName: "cert") pod "73145cf6-cd4d-4201-a0a4-4c60ccd908b3" (UID: "73145cf6-cd4d-4201-a0a4-4c60ccd908b3"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:16:15.469951 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.469851 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-kube-api-access-jn9fs" (OuterVolumeSpecName: "kube-api-access-jn9fs") pod "73145cf6-cd4d-4201-a0a4-4c60ccd908b3" (UID: "73145cf6-cd4d-4201-a0a4-4c60ccd908b3"). InnerVolumeSpecName "kube-api-access-jn9fs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:16:15.546198 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.546169 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:15.568456 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.568429 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn9fs\" (UniqueName: \"kubernetes.io/projected/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-kube-api-access-jn9fs\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:16:15.568456 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.568453 2582 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73145cf6-cd4d-4201-a0a4-4c60ccd908b3-cert\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:16:15.686267 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.686226 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-5gkvs"] Jul 28 17:16:15.688453 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:16:15.688429 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545f8784_9a65_4a7f_bdb1_048951485b46.slice/crio-10fb16067b5f491a7ece1f37f38025d47d7480d35cd8145664ec6dde033715f7 WatchSource:0}: Error finding container 10fb16067b5f491a7ece1f37f38025d47d7480d35cd8145664ec6dde033715f7: Status 404 returned error can't find the container with id 10fb16067b5f491a7ece1f37f38025d47d7480d35cd8145664ec6dde033715f7 Jul 28 17:16:15.999716 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:15.999685 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" event={"ID":"545f8784-9a65-4a7f-bdb1-048951485b46","Type":"ContainerStarted","Data":"10fb16067b5f491a7ece1f37f38025d47d7480d35cd8145664ec6dde033715f7"} Jul 28 17:16:16.000802 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:16.000779 2582 generic.go:356] "Generic (PLEG): container finished" podID="73145cf6-cd4d-4201-a0a4-4c60ccd908b3" containerID="1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204" exitCode=0 Jul 28 17:16:16.000919 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:16.000826 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" event={"ID":"73145cf6-cd4d-4201-a0a4-4c60ccd908b3","Type":"ContainerDied","Data":"1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204"} Jul 28 17:16:16.000919 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:16.000829 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" Jul 28 17:16:16.000919 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:16.000856 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-srmrf" event={"ID":"73145cf6-cd4d-4201-a0a4-4c60ccd908b3","Type":"ContainerDied","Data":"491cb6bf2f5d4acf9708f4fa2e5925e1de0562f6e9548c7bd9f1bc7979dbb88e"} Jul 28 17:16:16.000919 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:16.000876 2582 scope.go:117] "RemoveContainer" containerID="1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204" Jul 28 17:16:16.009381 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:16.009360 2582 scope.go:117] "RemoveContainer" containerID="1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204" Jul 28 17:16:16.009681 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:16:16.009662 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204\": container with ID starting with 1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204 not found: ID does not exist" containerID="1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204" Jul 28 17:16:16.009735 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:16.009690 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204"} err="failed to get container status \"1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204\": rpc error: code = NotFound desc = could not find container \"1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204\": container with ID starting with 1dab43a21da82cce2aaba4f3f64dbaed849e79856b1afda33eba536819129204 not found: ID does not exist" Jul 28 17:16:16.025888 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:16.025859 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-srmrf"] Jul 28 17:16:16.029502 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:16.029481 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-cd4d44c67-srmrf"] Jul 28 17:16:17.005728 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:17.005694 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" event={"ID":"545f8784-9a65-4a7f-bdb1-048951485b46","Type":"ContainerStarted","Data":"f652816419ac9043f51cd24d9cfea116c9d6f86629bd136c36198ff32c07abd1"} Jul 28 17:16:17.006245 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:17.005851 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:17.031959 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:17.031890 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" podStartSLOduration=1.527562262 podStartE2EDuration="2.031871363s" totalImagesPullingTime="504.309101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:16:17.030513783 +0000 UTC m=+414.372673136" watchObservedRunningTime="2026-07-28 17:16:17.031871363 +0000 UTC m=+414.374030715" Jul 28 17:16:17.260370 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:17.260295 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73145cf6-cd4d-4201-a0a4-4c60ccd908b3" path="/var/lib/kubelet/pods/73145cf6-cd4d-4201-a0a4-4c60ccd908b3/volumes" Jul 28 17:16:41.155547 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:41.155513 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:48.016118 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:48.016051 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-cd4d44c67-5gkvs" Jul 28 17:16:49.067824 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:49.067792 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:49.195454 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:49.195416 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:49.281182 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:49.281151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:49.382253 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:49.382148 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:49.900694 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:49.900643 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:16:49.960363 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:16:49.960335 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:17:19.516350 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.516316 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bbb95c96c-29w9b"] Jul 28 17:17:19.516821 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.516638 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73145cf6-cd4d-4201-a0a4-4c60ccd908b3" containerName="manager" Jul 28 17:17:19.516821 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.516649 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="73145cf6-cd4d-4201-a0a4-4c60ccd908b3" containerName="manager" Jul 28 17:17:19.516821 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.516714 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="73145cf6-cd4d-4201-a0a4-4c60ccd908b3" containerName="manager" Jul 28 17:17:19.519707 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.519689 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.525918 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.525578 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 17:17:19.525918 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.525617 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 17:17:19.525918 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.525614 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 17:17:19.526687 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.526672 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 17:17:19.526917 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.526901 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 17:17:19.527656 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.527603 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 17:17:19.528042 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.528025 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fcpnl\"" Jul 28 17:17:19.528234 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.528160 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 17:17:19.531003 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.530981 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 17:17:19.531542 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.531527 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bbb95c96c-29w9b"] Jul 28 17:17:19.585403 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.585366 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:17:19.593354 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.593326 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-oauth-serving-cert\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.593465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.593360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af0e5a0c-3b89-424f-8f7e-04ea7b472933-console-oauth-config\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.593465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.593379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-console-config\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.593465 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.593442 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-trusted-ca-bundle\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.593567 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.593499 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-service-ca\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.593567 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.593541 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af0e5a0c-3b89-424f-8f7e-04ea7b472933-console-serving-cert\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.593567 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.593563 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssnqx\" (UniqueName: \"kubernetes.io/projected/af0e5a0c-3b89-424f-8f7e-04ea7b472933-kube-api-access-ssnqx\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.652765 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.652730 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:17:19.694526 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.694504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-service-ca\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.694585 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.694546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af0e5a0c-3b89-424f-8f7e-04ea7b472933-console-serving-cert\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.694585 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.694570 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssnqx\" (UniqueName: \"kubernetes.io/projected/af0e5a0c-3b89-424f-8f7e-04ea7b472933-kube-api-access-ssnqx\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.694650 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.694613 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-oauth-serving-cert\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.694650 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.694641 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af0e5a0c-3b89-424f-8f7e-04ea7b472933-console-oauth-config\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.694734 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.694666 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-console-config\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.694734 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.694694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-trusted-ca-bundle\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.695327 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.695301 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-service-ca\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.695441 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.695389 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-oauth-serving-cert\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.695441 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.695423 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-console-config\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.695679 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.695661 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af0e5a0c-3b89-424f-8f7e-04ea7b472933-trusted-ca-bundle\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.697127 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.697097 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af0e5a0c-3b89-424f-8f7e-04ea7b472933-console-oauth-config\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.697333 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.697313 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af0e5a0c-3b89-424f-8f7e-04ea7b472933-console-serving-cert\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.704605 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.704581 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssnqx\" (UniqueName: \"kubernetes.io/projected/af0e5a0c-3b89-424f-8f7e-04ea7b472933-kube-api-access-ssnqx\") pod \"console-6bbb95c96c-29w9b\" (UID: \"af0e5a0c-3b89-424f-8f7e-04ea7b472933\") " pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.829651 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.829575 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:19.963436 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:19.963412 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bbb95c96c-29w9b"] Jul 28 17:17:19.965893 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:17:19.965864 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0e5a0c_3b89_424f_8f7e_04ea7b472933.slice/crio-09381f98fa845ae9392408e4f12d7d36017faa9d8a2de6739710143cf3a41e90 WatchSource:0}: Error finding container 09381f98fa845ae9392408e4f12d7d36017faa9d8a2de6739710143cf3a41e90: Status 404 returned error can't find the container with id 09381f98fa845ae9392408e4f12d7d36017faa9d8a2de6739710143cf3a41e90 Jul 28 17:17:20.245208 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:20.245171 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbb95c96c-29w9b" event={"ID":"af0e5a0c-3b89-424f-8f7e-04ea7b472933","Type":"ContainerStarted","Data":"9f24cadfa63ab2974d11ddaa586df24a4c712cc3db0117ebe960fe89573f17d6"} Jul 28 17:17:20.245367 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:20.245224 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bbb95c96c-29w9b" event={"ID":"af0e5a0c-3b89-424f-8f7e-04ea7b472933","Type":"ContainerStarted","Data":"09381f98fa845ae9392408e4f12d7d36017faa9d8a2de6739710143cf3a41e90"} Jul 28 17:17:20.266646 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:20.266594 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bbb95c96c-29w9b" podStartSLOduration=1.266577313 podStartE2EDuration="1.266577313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:20.266056461 +0000 UTC m=+477.608215812" watchObservedRunningTime="2026-07-28 17:17:20.266577313 +0000 UTC m=+477.608736664" Jul 28 17:17:29.829988 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:29.829956 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:29.830523 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:29.830041 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:29.834798 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:29.834778 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:30.292022 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:30.291990 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bbb95c96c-29w9b" Jul 28 17:17:30.453777 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:30.453744 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:17:30.554322 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:30.554244 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:17:30.616547 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:30.616517 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:17:55.350535 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:17:55.350499 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:18:17.898702 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:18:17.898604 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:18:26.737791 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:18:26.737755 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:18:26.839112 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:18:26.839077 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:18:38.934559 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:18:38.934513 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:18:39.278658 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:18:39.278627 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:15.840439 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:15.840401 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:17.104708 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:17.104672 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:17.856914 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:17.856881 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:17.957891 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:17.957860 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:24.045660 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:24.045630 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:24.150522 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:24.150495 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:24.248158 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:24.248120 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:24.415344 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:24.415265 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:24.716245 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:24.716171 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:27.426324 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:27.426289 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:20:27.507565 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:20:27.507534 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:04.160817 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.160782 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q"] Jul 28 17:22:04.164162 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.164140 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:04.166734 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.166702 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-5fb11-kube-rbac-proxy-sar-config\"" Jul 28 17:22:04.166910 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.166891 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 17:22:04.166994 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.166944 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-klwxk\"" Jul 28 17:22:04.168003 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.167986 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-5fb11-serving-cert\"" Jul 28 17:22:04.173946 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.173909 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q"] Jul 28 17:22:04.201447 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.201415 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:04.251301 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.251258 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d21a59e-28c6-4dd8-817f-433131f9bb25-openshift-service-ca-bundle\") pod \"model-chainer-raw-5fb11-7f4bdffbb9-2zv2q\" (UID: \"5d21a59e-28c6-4dd8-817f-433131f9bb25\") " pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:04.251479 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.251320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d21a59e-28c6-4dd8-817f-433131f9bb25-proxy-tls\") pod \"model-chainer-raw-5fb11-7f4bdffbb9-2zv2q\" (UID: \"5d21a59e-28c6-4dd8-817f-433131f9bb25\") " pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:04.283024 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.282990 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:04.352232 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.352196 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d21a59e-28c6-4dd8-817f-433131f9bb25-openshift-service-ca-bundle\") pod \"model-chainer-raw-5fb11-7f4bdffbb9-2zv2q\" (UID: \"5d21a59e-28c6-4dd8-817f-433131f9bb25\") " pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:04.352232 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.352234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d21a59e-28c6-4dd8-817f-433131f9bb25-proxy-tls\") pod \"model-chainer-raw-5fb11-7f4bdffbb9-2zv2q\" (UID: \"5d21a59e-28c6-4dd8-817f-433131f9bb25\") " pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:04.352904 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.352880 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d21a59e-28c6-4dd8-817f-433131f9bb25-openshift-service-ca-bundle\") pod \"model-chainer-raw-5fb11-7f4bdffbb9-2zv2q\" (UID: \"5d21a59e-28c6-4dd8-817f-433131f9bb25\") " pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:04.354601 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.354582 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d21a59e-28c6-4dd8-817f-433131f9bb25-proxy-tls\") pod \"model-chainer-raw-5fb11-7f4bdffbb9-2zv2q\" (UID: \"5d21a59e-28c6-4dd8-817f-433131f9bb25\") " pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:04.475797 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.475703 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:04.604554 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.604453 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q"] Jul 28 17:22:04.607296 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:22:04.607265 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d21a59e_28c6_4dd8_817f_433131f9bb25.slice/crio-8fad2f7a49f6d5a50e72771695f0ba80bed96526c9c54c9704cc3d2f74ff9382 WatchSource:0}: Error finding container 8fad2f7a49f6d5a50e72771695f0ba80bed96526c9c54c9704cc3d2f74ff9382: Status 404 returned error can't find the container with id 8fad2f7a49f6d5a50e72771695f0ba80bed96526c9c54c9704cc3d2f74ff9382 Jul 28 17:22:04.609068 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:04.609052 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:22:05.353826 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:05.353787 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" event={"ID":"5d21a59e-28c6-4dd8-817f-433131f9bb25","Type":"ContainerStarted","Data":"8fad2f7a49f6d5a50e72771695f0ba80bed96526c9c54c9704cc3d2f74ff9382"} Jul 28 17:22:07.363010 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:07.362975 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" event={"ID":"5d21a59e-28c6-4dd8-817f-433131f9bb25","Type":"ContainerStarted","Data":"f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a"} Jul 28 17:22:07.363459 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:07.363096 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:07.380719 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:07.380671 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" podStartSLOduration=1.595033104 podStartE2EDuration="3.380657697s" totalImagesPullingTime="1.785624593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:07.37923712 +0000 UTC m=+764.721396492" watchObservedRunningTime="2026-07-28 17:22:07.380657697 +0000 UTC m=+764.722817048" Jul 28 17:22:13.373645 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:13.373615 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:14.216310 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:14.216281 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q"] Jul 28 17:22:14.216518 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:14.216493 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" containerID="cri-o://f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a" gracePeriod=30 Jul 28 17:22:14.242677 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:14.242651 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:14.409658 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:14.409611 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:14.488014 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:14.487984 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:14.564291 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:14.564256 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:14.700892 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:14.700861 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:14.793910 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:14.793833 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:15.029821 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:15.029770 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:22:18.371497 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:18.371454 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:22:23.371467 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:23.371426 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:22:28.371184 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:28.371147 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:22:28.371548 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:28.371274 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:33.371201 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:33.371160 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:22:38.371621 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:38.371572 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:22:43.371030 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:43.370991 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:22:44.357581 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.357558 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:44.500231 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.500203 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d21a59e-28c6-4dd8-817f-433131f9bb25-openshift-service-ca-bundle\") pod \"5d21a59e-28c6-4dd8-817f-433131f9bb25\" (UID: \"5d21a59e-28c6-4dd8-817f-433131f9bb25\") " Jul 28 17:22:44.500682 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.500270 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d21a59e-28c6-4dd8-817f-433131f9bb25-proxy-tls\") pod \"5d21a59e-28c6-4dd8-817f-433131f9bb25\" (UID: \"5d21a59e-28c6-4dd8-817f-433131f9bb25\") " Jul 28 17:22:44.500682 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.500565 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d21a59e-28c6-4dd8-817f-433131f9bb25-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5d21a59e-28c6-4dd8-817f-433131f9bb25" (UID: "5d21a59e-28c6-4dd8-817f-433131f9bb25"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:22:44.502435 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.502412 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d21a59e-28c6-4dd8-817f-433131f9bb25-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5d21a59e-28c6-4dd8-817f-433131f9bb25" (UID: "5d21a59e-28c6-4dd8-817f-433131f9bb25"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:22:44.514132 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.514106 2582 generic.go:356] "Generic (PLEG): container finished" podID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerID="f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a" exitCode=0 Jul 28 17:22:44.514235 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.514149 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" Jul 28 17:22:44.514235 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.514184 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" event={"ID":"5d21a59e-28c6-4dd8-817f-433131f9bb25","Type":"ContainerDied","Data":"f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a"} Jul 28 17:22:44.514309 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.514233 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q" event={"ID":"5d21a59e-28c6-4dd8-817f-433131f9bb25","Type":"ContainerDied","Data":"8fad2f7a49f6d5a50e72771695f0ba80bed96526c9c54c9704cc3d2f74ff9382"} Jul 28 17:22:44.514309 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.514260 2582 scope.go:117] "RemoveContainer" containerID="f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a" Jul 28 17:22:44.523329 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.523315 2582 scope.go:117] "RemoveContainer" containerID="f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a" Jul 28 17:22:44.523606 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:22:44.523589 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a\": container with ID starting with f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a not found: ID does not exist" containerID="f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a" Jul 28 17:22:44.523662 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.523616 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a"} err="failed to get container status \"f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a\": rpc error: code = NotFound desc = could not find container \"f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a\": container with ID starting with f499d841bdc68ba5f1542000d815f843c7128d6daad5271819cd206379ae9c4a not found: ID does not exist" Jul 28 17:22:44.545835 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.545811 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q"] Jul 28 17:22:44.560809 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.560788 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-5fb11-7f4bdffbb9-2zv2q"] Jul 28 17:22:44.601345 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.601323 2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5d21a59e-28c6-4dd8-817f-433131f9bb25-proxy-tls\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:22:44.601345 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:44.601344 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d21a59e-28c6-4dd8-817f-433131f9bb25-openshift-service-ca-bundle\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:22:45.260002 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:22:45.259974 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" path="/var/lib/kubelet/pods/5d21a59e-28c6-4dd8-817f-433131f9bb25/volumes" Jul 28 17:23:39.473358 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:39.473328 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:23:54.509256 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.509220 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q"] Jul 28 17:23:54.509706 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.509569 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" Jul 28 17:23:54.509706 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.509585 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" Jul 28 17:23:54.509706 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.509659 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d21a59e-28c6-4dd8-817f-433131f9bb25" containerName="model-chainer-raw-5fb11" Jul 28 17:23:54.510247 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.510216 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:23:54.512635 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.512610 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:23:54.515223 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.515199 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 17:23:54.515341 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.515271 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-klwxk\"" Jul 28 17:23:54.515341 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.515327 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-c3acd-kube-rbac-proxy-sar-config\"" Jul 28 17:23:54.516270 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.516251 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-c3acd-serving-cert\"" Jul 28 17:23:54.522163 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.522138 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q"] Jul 28 17:23:54.573481 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.573449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/feeea449-9151-4360-a7ff-19acb150d405-proxy-tls\") pod \"model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q\" (UID: \"feeea449-9151-4360-a7ff-19acb150d405\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:23:54.573647 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.573528 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feeea449-9151-4360-a7ff-19acb150d405-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q\" (UID: \"feeea449-9151-4360-a7ff-19acb150d405\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:23:54.674394 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.674364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feeea449-9151-4360-a7ff-19acb150d405-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q\" (UID: \"feeea449-9151-4360-a7ff-19acb150d405\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:23:54.674536 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.674407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/feeea449-9151-4360-a7ff-19acb150d405-proxy-tls\") pod \"model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q\" (UID: \"feeea449-9151-4360-a7ff-19acb150d405\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:23:54.674989 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.674971 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feeea449-9151-4360-a7ff-19acb150d405-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q\" (UID: \"feeea449-9151-4360-a7ff-19acb150d405\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:23:54.676724 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.676708 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/feeea449-9151-4360-a7ff-19acb150d405-proxy-tls\") pod \"model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q\" (UID: \"feeea449-9151-4360-a7ff-19acb150d405\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:23:54.703142 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.703110 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:23:54.823688 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.823616 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:23:54.952455 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:54.952431 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q"] Jul 28 17:23:54.955054 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:23:54.955027 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeeea449_9151_4360_a7ff_19acb150d405.slice/crio-63d5086518b8221f1b42879c7ab67cbbf344d66e5eafbfe0188ab99f47cc7a10 WatchSource:0}: Error finding container 63d5086518b8221f1b42879c7ab67cbbf344d66e5eafbfe0188ab99f47cc7a10: Status 404 returned error can't find the container with id 63d5086518b8221f1b42879c7ab67cbbf344d66e5eafbfe0188ab99f47cc7a10 Jul 28 17:23:55.786140 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:55.786108 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" event={"ID":"feeea449-9151-4360-a7ff-19acb150d405","Type":"ContainerStarted","Data":"549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430"} Jul 28 17:23:55.786490 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:55.786162 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" event={"ID":"feeea449-9151-4360-a7ff-19acb150d405","Type":"ContainerStarted","Data":"63d5086518b8221f1b42879c7ab67cbbf344d66e5eafbfe0188ab99f47cc7a10"} Jul 28 17:23:55.786490 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:55.786193 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:23:55.808326 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:23:55.808281 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" podStartSLOduration=1.8082671590000001 podStartE2EDuration="1.808267159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:55.80732164 +0000 UTC m=+873.149480993" watchObservedRunningTime="2026-07-28 17:23:55.808267159 +0000 UTC m=+873.150426551" Jul 28 17:24:01.795747 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:01.795721 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:24:04.637144 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:04.637105 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q"] Jul 28 17:24:04.637572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:04.637302 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" containerID="cri-o://549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430" gracePeriod=30 Jul 28 17:24:04.666197 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:04.666165 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:24:04.840953 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:04.840891 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:24:04.926241 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:04.926153 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:24:05.000045 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:05.000016 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:24:05.509999 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:05.509964 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:24:06.794719 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:06.794683 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:24:11.794750 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:11.794704 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:24:16.794867 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:16.794779 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:24:16.795336 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:16.794953 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:24:21.794074 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:21.794037 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:24:24.832266 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:24.832214 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:24:25.080079 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:25.080044 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:24:26.794686 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:26.794645 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:24:28.073572 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:28.073542 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:24:31.794672 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:31.794633 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 17:24:34.784490 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.784460 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:24:34.915350 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.915260 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/feeea449-9151-4360-a7ff-19acb150d405-proxy-tls\") pod \"feeea449-9151-4360-a7ff-19acb150d405\" (UID: \"feeea449-9151-4360-a7ff-19acb150d405\") " Jul 28 17:24:34.915495 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.915366 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feeea449-9151-4360-a7ff-19acb150d405-openshift-service-ca-bundle\") pod \"feeea449-9151-4360-a7ff-19acb150d405\" (UID: \"feeea449-9151-4360-a7ff-19acb150d405\") " Jul 28 17:24:34.915714 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.915683 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feeea449-9151-4360-a7ff-19acb150d405-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "feeea449-9151-4360-a7ff-19acb150d405" (UID: "feeea449-9151-4360-a7ff-19acb150d405"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:24:34.917278 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.917258 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feeea449-9151-4360-a7ff-19acb150d405-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "feeea449-9151-4360-a7ff-19acb150d405" (UID: "feeea449-9151-4360-a7ff-19acb150d405"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:24:34.941036 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.941003 2582 generic.go:356] "Generic (PLEG): container finished" podID="feeea449-9151-4360-a7ff-19acb150d405" containerID="549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430" exitCode=0 Jul 28 17:24:34.941189 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.941048 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" Jul 28 17:24:34.941189 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.941057 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" event={"ID":"feeea449-9151-4360-a7ff-19acb150d405","Type":"ContainerDied","Data":"549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430"} Jul 28 17:24:34.941189 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.941106 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q" event={"ID":"feeea449-9151-4360-a7ff-19acb150d405","Type":"ContainerDied","Data":"63d5086518b8221f1b42879c7ab67cbbf344d66e5eafbfe0188ab99f47cc7a10"} Jul 28 17:24:34.941189 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.941133 2582 scope.go:117] "RemoveContainer" containerID="549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430" Jul 28 17:24:34.949639 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.949622 2582 scope.go:117] "RemoveContainer" containerID="549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430" Jul 28 17:24:34.949902 ip-10-0-128-156 kubenswrapper[2582]: E0728 17:24:34.949887 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430\": container with ID starting with 549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430 not found: ID does not exist" containerID="549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430" Jul 28 17:24:34.949962 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.949911 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430"} err="failed to get container status \"549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430\": rpc error: code = NotFound desc = could not find container \"549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430\": container with ID starting with 549584e658250edb12ab22f46562cb57f1bdcb5e6c8b3b62b101b5081d0f4430 not found: ID does not exist" Jul 28 17:24:34.964485 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.964449 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q"] Jul 28 17:24:34.968243 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:34.968216 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c3acd-6ff77f57cd-s6h2q"] Jul 28 17:24:35.016445 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:35.016411 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feeea449-9151-4360-a7ff-19acb150d405-openshift-service-ca-bundle\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:24:35.016445 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:35.016443 2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/feeea449-9151-4360-a7ff-19acb150d405-proxy-tls\") on node \"ip-10-0-128-156.ec2.internal\" DevicePath \"\"" Jul 28 17:24:35.260478 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:24:35.260451 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feeea449-9151-4360-a7ff-19acb150d405" path="/var/lib/kubelet/pods/feeea449-9151-4360-a7ff-19acb150d405/volumes" Jul 28 17:26:00.197576 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:26:00.197477 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:26:02.226292 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:26:02.226257 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:28:50.665287 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:28:50.665186 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:28:55.624126 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:28:55.624094 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:28:55.732393 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:28:55.732329 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:28:56.084300 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:28:56.084269 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:28:56.161044 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:28:56.161011 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:29:35.337885 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:29:35.337846 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:25.806084 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:25.806050 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:25.874107 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:25.874073 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:30.870769 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:30.870740 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:30.945380 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:30.945346 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:31.017767 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:31.017737 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:31.281487 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:31.281457 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:41.067159 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:41.067119 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:42.147234 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:42.147205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:46.481939 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:46.481902 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:30:46.546377 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:30:46.546342 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:32:01.034081 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:32:01.033969 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:33:41.349141 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:33:41.349109 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:33:47.562849 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:33:47.562815 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:33:47.623990 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:33:47.623962 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:35:16.557685 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:35:16.557618 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:36:36.682250 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:36:36.682214 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:36:41.834564 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:36:41.834530 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:36:41.978429 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:36:41.978399 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:36:42.110515 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:36:42.110431 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:36:42.472303 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:36:42.472215 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:38:00.143903 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:38:00.143866 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:38:11.923947 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:38:11.923898 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:38:11.988766 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:38:11.988725 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:38:22.173730 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:38:22.173693 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:38:22.365133 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:38:22.365100 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:38:57.190466 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:38:57.190430 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:40:07.453647 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:40:07.453588 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:40:07.638394 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:40:07.638360 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:40:25.575064 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:40:25.575035 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:40:25.658600 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:40:25.658565 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:40:30.742121 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:40:30.742092 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:40:30.875017 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:40:30.874988 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:40:35.798762 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:40:35.798726 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:40:41.036966 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:40:41.036913 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:40:41.322172 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:40:41.322083 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:42:11.226268 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:42:11.226231 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:42:16.315131 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:42:16.315054 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:42:16.480579 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:42:16.480546 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:43:46.602691 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:43:46.602594 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:43:52.682488 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:43:52.682439 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:43:52.745363 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:43:52.745331 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:44:22.784139 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.784089 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:44:22.950297 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.950265 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-spfd9/must-gather-9hf6d"] Jul 28 17:44:22.950591 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.950577 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" Jul 28 17:44:22.950591 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.950590 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" Jul 28 17:44:22.950729 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.950651 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="feeea449-9151-4360-a7ff-19acb150d405" containerName="model-chainer-raw-hpa-c3acd" Jul 28 17:44:22.953637 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.953622 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spfd9/must-gather-9hf6d" Jul 28 17:44:22.955911 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.955889 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:44:22.956621 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.956599 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-spfd9\"/\"default-dockercfg-992qv\"" Jul 28 17:44:22.956719 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.956639 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spfd9\"/\"openshift-service-ca.crt\"" Jul 28 17:44:22.956719 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.956645 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spfd9\"/\"kube-root-ca.crt\"" Jul 28 17:44:22.962029 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:22.962005 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spfd9/must-gather-9hf6d"] Jul 28 17:44:23.020180 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.020145 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:44:23.050177 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.050094 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jclkx\" (UniqueName: \"kubernetes.io/projected/5185b62c-7a50-4053-8d71-35dd2344f90b-kube-api-access-jclkx\") pod \"must-gather-9hf6d\" (UID: \"5185b62c-7a50-4053-8d71-35dd2344f90b\") " pod="openshift-must-gather-spfd9/must-gather-9hf6d" Jul 28 17:44:23.050308 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.050194 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5185b62c-7a50-4053-8d71-35dd2344f90b-must-gather-output\") pod \"must-gather-9hf6d\" (UID: \"5185b62c-7a50-4053-8d71-35dd2344f90b\") " pod="openshift-must-gather-spfd9/must-gather-9hf6d" Jul 28 17:44:23.151552 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.151514 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5185b62c-7a50-4053-8d71-35dd2344f90b-must-gather-output\") pod \"must-gather-9hf6d\" (UID: \"5185b62c-7a50-4053-8d71-35dd2344f90b\") " pod="openshift-must-gather-spfd9/must-gather-9hf6d" Jul 28 17:44:23.151741 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.151565 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jclkx\" (UniqueName: \"kubernetes.io/projected/5185b62c-7a50-4053-8d71-35dd2344f90b-kube-api-access-jclkx\") pod \"must-gather-9hf6d\" (UID: \"5185b62c-7a50-4053-8d71-35dd2344f90b\") " pod="openshift-must-gather-spfd9/must-gather-9hf6d" Jul 28 17:44:23.151966 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.151945 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5185b62c-7a50-4053-8d71-35dd2344f90b-must-gather-output\") pod \"must-gather-9hf6d\" (UID: \"5185b62c-7a50-4053-8d71-35dd2344f90b\") " pod="openshift-must-gather-spfd9/must-gather-9hf6d" Jul 28 17:44:23.159809 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.159791 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spfd9\"/\"kube-root-ca.crt\"" Jul 28 17:44:23.170613 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.170589 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spfd9\"/\"openshift-service-ca.crt\"" Jul 28 17:44:23.181215 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.181191 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jclkx\" (UniqueName: \"kubernetes.io/projected/5185b62c-7a50-4053-8d71-35dd2344f90b-kube-api-access-jclkx\") pod \"must-gather-9hf6d\" (UID: \"5185b62c-7a50-4053-8d71-35dd2344f90b\") " pod="openshift-must-gather-spfd9/must-gather-9hf6d" Jul 28 17:44:23.266103 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.266076 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-spfd9\"/\"default-dockercfg-992qv\"" Jul 28 17:44:23.274238 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.274207 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spfd9/must-gather-9hf6d" Jul 28 17:44:23.405624 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.405589 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spfd9/must-gather-9hf6d"] Jul 28 17:44:23.408423 ip-10-0-128-156 kubenswrapper[2582]: W0728 17:44:23.408395 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5185b62c_7a50_4053_8d71_35dd2344f90b.slice/crio-3591c2f2f1ad3008fae47b8f73d6122294836d58de5ee361a2c0e02c52b6f25d WatchSource:0}: Error finding container 3591c2f2f1ad3008fae47b8f73d6122294836d58de5ee361a2c0e02c52b6f25d: Status 404 returned error can't find the container with id 3591c2f2f1ad3008fae47b8f73d6122294836d58de5ee361a2c0e02c52b6f25d Jul 28 17:44:23.410296 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.410281 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:44:23.486818 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:23.486781 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spfd9/must-gather-9hf6d" event={"ID":"5185b62c-7a50-4053-8d71-35dd2344f90b","Type":"ContainerStarted","Data":"3591c2f2f1ad3008fae47b8f73d6122294836d58de5ee361a2c0e02c52b6f25d"} Jul 28 17:44:25.500600 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:25.500560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spfd9/must-gather-9hf6d" event={"ID":"5185b62c-7a50-4053-8d71-35dd2344f90b","Type":"ContainerStarted","Data":"849f6a13acd87e7e6cd3c5e9da135f826fc740b596ce805c1dcd0b38686bca46"} Jul 28 17:44:25.501076 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:25.500616 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spfd9/must-gather-9hf6d" event={"ID":"5185b62c-7a50-4053-8d71-35dd2344f90b","Type":"ContainerStarted","Data":"3c58b4a17dee77564d276566f67cdd2c25793848a0ecfec800146dc32e115a43"} Jul 28 17:44:25.522370 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:25.522307 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-spfd9/must-gather-9hf6d" podStartSLOduration=2.480016472 podStartE2EDuration="3.522285235s" totalImagesPullingTime="1.042268763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:44:25.519776565 +0000 UTC m=+2102.861935916" watchObservedRunningTime="2026-07-28 17:44:25.522285235 +0000 UTC m=+2102.864444587" Jul 28 17:44:25.997066 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:25.997038 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jk4l4_1532bb2e-4650-4582-aa75-6714e5c29108/global-pull-secret-syncer/0.log" Jul 28 17:44:26.116636 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:26.116605 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" Jul 28 17:44:26.221375 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:26.221329 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-156.ec2.internal_0d66673e539a82e82550c56d52df9dc8/haproxy/0.log" Jul 28 17:44:28.449213 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:28.449146 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:44:28.547746 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:28.547683 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9vrfp_6e6f3e76-1c4e-477c-8cbe-150e96f8b72d/konnectivity-agent/0.log" limit=1024 Jul 28 17:44:29.871995 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:29.871958 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2c9e9cf-83af-4e03-9bdf-f06766702cc7/alertmanager/0.log" Jul 28 17:44:29.904040 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:29.903998 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2c9e9cf-83af-4e03-9bdf-f06766702cc7/config-reloader/0.log" Jul 28 17:44:29.940993 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:29.940947 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2c9e9cf-83af-4e03-9bdf-f06766702cc7/kube-rbac-proxy-web/0.log" Jul 28 17:44:29.977070 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:29.977030 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2c9e9cf-83af-4e03-9bdf-f06766702cc7/kube-rbac-proxy/0.log" Jul 28 17:44:30.018862 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.018792 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2c9e9cf-83af-4e03-9bdf-f06766702cc7/kube-rbac-proxy-metric/0.log" Jul 28 17:44:30.047074 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.047051 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2c9e9cf-83af-4e03-9bdf-f06766702cc7/prom-label-proxy/0.log" Jul 28 17:44:30.079254 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.079228 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2c9e9cf-83af-4e03-9bdf-f06766702cc7/init-config-reloader/0.log" Jul 28 17:44:30.162545 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.162474 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xhvlq_c0a9053e-bfa4-44ae-9d20-693623694c1a/kube-state-metrics/0.log" Jul 28 17:44:30.195442 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.195418 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xhvlq_c0a9053e-bfa4-44ae-9d20-693623694c1a/kube-rbac-proxy-main/0.log" Jul 28 17:44:30.226468 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.226424 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xhvlq_c0a9053e-bfa4-44ae-9d20-693623694c1a/kube-rbac-proxy-self/0.log" Jul 28 17:44:30.349133 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.349107 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gdv5_4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb/node-exporter/0.log" Jul 28 17:44:30.374620 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.374587 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gdv5_4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb/kube-rbac-proxy/0.log" Jul 28 17:44:30.401137 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.401105 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gdv5_4f1ab27f-ceea-42ec-a2fc-171c1cdb8fcb/init-textfile/0.log" Jul 28 17:44:30.950835 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.950814 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-lspd6_ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b/prometheus-operator/0.log" Jul 28 17:44:30.975583 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:30.975539 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-lspd6_ffb7d5bb-2399-47b1-a3e1-715f8eac2c6b/kube-rbac-proxy/0.log" Jul 28 17:44:31.005075 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:31.005042 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-8jcv6_15c7486c-07b6-499a-97cb-eeec7bdbc953/prometheus-operator-admission-webhook/0.log" Jul 28 17:44:31.040102 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:31.040077 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-678cfff567-xwt6r_f83f317c-7fcd-4ff0-9c6a-310cca5e2da6/telemeter-client/0.log" Jul 28 17:44:31.065441 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:31.065412 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-678cfff567-xwt6r_f83f317c-7fcd-4ff0-9c6a-310cca5e2da6/reload/0.log" Jul 28 17:44:31.090861 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:31.090836 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-678cfff567-xwt6r_f83f317c-7fcd-4ff0-9c6a-310cca5e2da6/kube-rbac-proxy/0.log" Jul 28 17:44:33.568347 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:33.568318 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bbb95c96c-29w9b_af0e5a0c-3b89-424f-8f7e-04ea7b472933/console/0.log" Jul 28 17:44:34.283410 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.283374 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj"] Jul 28 17:44:34.289238 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.289216 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.296277 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.296252 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj"] Jul 28 17:44:34.353349 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.353315 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-proc\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.353513 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.353473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-lib-modules\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.353620 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.353600 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dgp5\" (UniqueName: \"kubernetes.io/projected/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-kube-api-access-6dgp5\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.353699 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.353637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-sys\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.353699 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.353666 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-podres\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.454644 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.454604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-lib-modules\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.454840 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.454719 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dgp5\" (UniqueName: \"kubernetes.io/projected/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-kube-api-access-6dgp5\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.454840 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.454742 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-lib-modules\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.454840 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.454754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-sys\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.454840 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.454805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-podres\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.454840 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.454823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-proc\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.455156 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.454917 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-sys\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.455156 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.454952 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-podres\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.455156 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.454966 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-proc\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.463747 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.463720 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dgp5\" (UniqueName: \"kubernetes.io/projected/c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3-kube-api-access-6dgp5\") pod \"perf-node-gather-daemonset-tdwtj\" (UID: \"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.602234 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.602158 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:34.768684 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:34.768583 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj"] Jul 28 17:44:35.177015 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:35.176950 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kjd8p_e0467685-66af-4387-a17e-f30ecd28dcdf/dns/0.log" Jul 28 17:44:35.201289 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:35.201267 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kjd8p_e0467685-66af-4387-a17e-f30ecd28dcdf/kube-rbac-proxy/0.log" Jul 28 17:44:35.283206 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:35.283173 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kqr4w_42642d3c-a017-4969-8415-87c24243cf65/dns-node-resolver/0.log" Jul 28 17:44:35.557704 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:35.557672 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" event={"ID":"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3","Type":"ContainerStarted","Data":"3df94027968c8150f0f6a2c18e77ac06b1636c585f7539b2e18b40ec3264ab01"} Jul 28 17:44:35.557867 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:35.557725 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" event={"ID":"c30d7d76-4e07-4dd1-9bcb-03642e9ddcd3","Type":"ContainerStarted","Data":"a2cb427f195dfb1b4e407d8898315484262796c90a4343060d15912bdaa2828c"} Jul 28 17:44:35.557867 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:35.557756 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:35.576419 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:35.576359 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" podStartSLOduration=1.576338612 podStartE2EDuration="1.576338612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:44:35.574894302 +0000 UTC m=+2112.917053656" watchObservedRunningTime="2026-07-28 17:44:35.576338612 +0000 UTC m=+2112.918497964" Jul 28 17:44:35.867310 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:35.867235 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5ch8f_0a8de880-d4ae-479c-a1fa-24542a000e2d/node-ca/0.log" Jul 28 17:44:37.062592 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:37.062565 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s424p_c62ff42b-7e5d-4310-bb19-00a15b991f42/serve-healthcheck-canary/0.log" Jul 28 17:44:37.553113 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:37.553083 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-68t4w_e43cdc71-c28c-4fb8-a301-e60f41ef38d4/kube-rbac-proxy/0.log" Jul 28 17:44:37.577803 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:37.577758 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-68t4w_e43cdc71-c28c-4fb8-a301-e60f41ef38d4/exporter/0.log" Jul 28 17:44:37.605231 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:37.605205 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-68t4w_e43cdc71-c28c-4fb8-a301-e60f41ef38d4/extractor/0.log" Jul 28 17:44:39.956303 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:39.956266 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-cd4d44c67-5gkvs_545f8784-9a65-4a7f-bdb1-048951485b46/manager/0.log" Jul 28 17:44:40.227049 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:40.226967 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-zcqgj_aaaf7189-4d14-4e93-b39b-b96dc77fc866/seaweedfs/0.log" Jul 28 17:44:41.574653 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:41.574629 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-tdwtj" Jul 28 17:44:46.012227 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.012189 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-99s7f_8aef4695-ff40-4b36-8b91-09d435defed0/kube-multus/0.log" Jul 28 17:44:46.228552 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.228522 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwr67_3bc75559-78ce-4b71-9a58-aeb5a07a5f33/kube-multus-additional-cni-plugins/0.log" Jul 28 17:44:46.253687 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.253654 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwr67_3bc75559-78ce-4b71-9a58-aeb5a07a5f33/egress-router-binary-copy/0.log" Jul 28 17:44:46.279447 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.279421 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwr67_3bc75559-78ce-4b71-9a58-aeb5a07a5f33/cni-plugins/0.log" Jul 28 17:44:46.304564 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.304538 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwr67_3bc75559-78ce-4b71-9a58-aeb5a07a5f33/bond-cni-plugin/0.log" Jul 28 17:44:46.331889 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.331862 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwr67_3bc75559-78ce-4b71-9a58-aeb5a07a5f33/routeoverride-cni/0.log" Jul 28 17:44:46.361450 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.361376 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwr67_3bc75559-78ce-4b71-9a58-aeb5a07a5f33/whereabouts-cni-bincopy/0.log" Jul 28 17:44:46.387020 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.386986 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bwr67_3bc75559-78ce-4b71-9a58-aeb5a07a5f33/whereabouts-cni/0.log" Jul 28 17:44:46.668588 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.668515 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t2sqf_f78774be-c7f7-43ae-a745-08394c8732b1/network-metrics-daemon/0.log" Jul 28 17:44:46.691447 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:46.691398 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t2sqf_f78774be-c7f7-43ae-a745-08394c8732b1/kube-rbac-proxy/0.log" Jul 28 17:44:48.089247 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:48.089214 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrs4m_6ab10076-672a-4497-b3a7-7748c94ec5c0/ovn-controller/0.log" Jul 28 17:44:48.113985 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:48.113955 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrs4m_6ab10076-672a-4497-b3a7-7748c94ec5c0/ovn-acl-logging/0.log" Jul 28 17:44:48.145106 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:48.145077 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrs4m_6ab10076-672a-4497-b3a7-7748c94ec5c0/kube-rbac-proxy-node/0.log" Jul 28 17:44:48.169775 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:48.169742 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrs4m_6ab10076-672a-4497-b3a7-7748c94ec5c0/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 17:44:48.193870 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:48.193842 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrs4m_6ab10076-672a-4497-b3a7-7748c94ec5c0/northd/0.log" Jul 28 17:44:48.218400 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:48.218372 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrs4m_6ab10076-672a-4497-b3a7-7748c94ec5c0/nbdb/0.log" Jul 28 17:44:48.245414 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:48.245362 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrs4m_6ab10076-672a-4497-b3a7-7748c94ec5c0/sbdb/0.log" Jul 28 17:44:48.291425 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:48.291399 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xrs4m_6ab10076-672a-4497-b3a7-7748c94ec5c0/ovnkube-controller/0.log" Jul 28 17:44:49.432746 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:49.432722 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mp4jl_23ac9a6a-7d2d-4707-b3b9-8092af22fa23/network-check-target-container/0.log" Jul 28 17:44:50.397538 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:50.397509 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jznmz_5c5f4cb9-150e-49a1-89e8-02a5cdf8819d/iptables-alerter/0.log" Jul 28 17:44:51.245854 ip-10-0-128-156 kubenswrapper[2582]: I0728 17:44:51.245829 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zpwvd_80ac223f-ed41-475c-a79a-1e830b4d20d1/tuned/0.log"